Apr 07 19:34:52.143634 np0000164077 systemd[1]: Started devstack@neutron-ovn-maintenance-worker.service - Devstack devstack@neutron-ovn-maintenance-worker.service.
Apr 07 19:34:52.467347 np0000164077 neutron-ovn-maintenance-worker[103723]: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:41: EventletDeprecationWarning:
Apr 07 19:34:52.467347 np0000164077 neutron-ovn-maintenance-worker[103723]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 07 19:34:52.467347 np0000164077 neutron-ovn-maintenance-worker[103723]: we strongly recommend against using it for new projects.
Apr 07 19:34:52.467347 np0000164077 neutron-ovn-maintenance-worker[103723]: If you are already using Eventlet, we recommend migrating to a different
Apr 07 19:34:52.467347 np0000164077 neutron-ovn-maintenance-worker[103723]: framework.  For more detail see
Apr 07 19:34:52.467347 np0000164077 neutron-ovn-maintenance-worker[103723]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 07 19:34:52.467347 np0000164077 neutron-ovn-maintenance-worker[103723]:   import eventlet
Apr 07 19:34:53.653728 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.common.config [-] Logging enabled!
Apr 07 19:34:53.654394 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-ovn-maintenance-worker version 28.1.0.dev90
Apr 07 19:34:53.654394 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-ovn-maintenance-worker --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=103723) setup_logging /opt/stack/neutron/neutron/common/config.py:124}}
Apr 07 19:34:53.654394 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.server.ovn_maintenance [-] OVN maintenance process starting...
Apr 07 19:34:53.654554 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "plugin-directory" by "neutron_lib.plugins.directory._create_plugin_directory" {{(pid=103723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 07 19:34:53.654554 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=103723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 07 19:34:53.654821 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.000s {{(pid=103723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 07 19:34:53.654821 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "manager" by "neutron.manager.NeutronManager._create_instance" {{(pid=103723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 07 19:34:53.654821 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=103723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 07 19:34:53.654821 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.manager [-] Loading core plugin: ml2
Apr 07 19:34:53.937513 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:53.937513 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:53.937513 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:53.937964 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:53.938108 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:53.938108 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:53.974871 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:53.975025 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:53.975025 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:53.981422 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:53.981545 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:53.981545 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.184092 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.184092 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.184092 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.184092 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.184092 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.184496 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.251462 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7325bcb5a2a0> agent after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.251462 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7325bcb5a2a0> agent after_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.251697 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x7325bcb5a340> segment precommit_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.251697 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x7325bcb5a3e0> network precommit_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.251864 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x7325bcb5b600> segment before_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.309118 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> network before_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.309288 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x7325bcb4af20> agent before_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.309288 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> network before_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.309288 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> port before_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.309454 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> port before_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.309454 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> segment precommit_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.309454 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> segment precommit_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.309624 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> segment after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.309624 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> segment after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.309624 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> network after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.310175 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> network precommit_delete 0, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.310175 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> port provisioning_complete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.310175 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> rbac-policy before_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.310175 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> rbac-policy after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.310175 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> agent after_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.310521 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> subnet after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.310521 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> subnet precommit_delete 0, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.310521 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> rbac-policy before_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.310521 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> rbac-policy before_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.310521 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> segment_host_mapping after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.310902 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin.delete_agent_notified of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> agent after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.310902 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> rbac-policy before_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.310902 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> rbac-policy before_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.310902 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7325bccf2ab0>> rbac-policy before_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.310902 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=103723) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 07 19:34:54.311229 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=103723) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 07 19:34:54.311229 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=103723) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 07 19:34:54.311229 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=103723) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 07 19:34:54.311229 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=103723) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 07 19:34:54.311229 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=103723) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 07 19:34:54.311522 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'geneve']
Apr 07 19:34:54.312202 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['public']
Apr 07 19:34:54.312816 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
Apr 07 19:34:54.313770 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict({'public': [(1, 4094)]})
Apr 07 19:34:54.313826 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'local', 'vlan']
Apr 07 19:34:54.313998 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'local', 'vlan'])
Apr 07 19:34:54.314096 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [-] Project network_types: ['geneve']
Apr 07 19:34:54.314217 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security', 'qos']
Apr 07 19:34:54.314742 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security', 'qos']
Apr 07 19:34:54.314796 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security', 'qos']
Apr 07 19:34:54.314944 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['ovn']
Apr 07 19:34:54.355883 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['ovn']
Apr 07 19:34:54.356025 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['ovn']
Apr 07 19:34:54.356025 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [-] No mechanism drivers provide segment reachability information for agent scheduling.
Apr 07 19:34:54.356607 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7325bccd2c30>> floatingip before_response 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.356686 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7325bccd2c30>> port before_response 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:54.381625 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
Apr 07 19:34:54.381717 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
Apr 07 19:34:54.381717 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
Apr 07 19:34:54.381855 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 65536)]
Apr 07 19:34:54.430599 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO dbcounter [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Registered counter for database neutron
Apr 07 19:34:54.450016 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG oslo_db.sqlalchemy.engines [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103723) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 07 19:34:54.954176 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG dbcounter [-] [103723] Writer thread running {{(pid=103723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 07 19:34:55.146465 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Initializing driver for type 'local'
Apr 07 19:34:55.146715 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Initializing driver for type 'vlan'
Apr 07 19:34:55.266634 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] VlanTypeDriver initialization complete
Apr 07 19:34:55.266953 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Initializing extension driver 'port_security'
Apr 07 19:34:55.266953 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.extensions.port_security [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] PortSecurityExtensionDriver initialization complete
Apr 07 19:34:55.266953 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Initializing extension driver 'qos'
Apr 07 19:34:55.267194 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.plugins.ml2.extensions.qos [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] QosExtensionDriver initialization complete {{(pid=103723) initialize /opt/stack/neutron/neutron/plugins/ml2/extensions/qos.py:31}}
Apr 07 19:34:55.267194 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Initializing mechanism driver 'ovn'
Apr 07 19:34:55.267314 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Starting OVNMechanismDriver
Apr 07 19:34:55.271218 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNMechanismDriver.pre_fork_initialize of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7325bc8967b0>> process before_spawn 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.271419 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNMechanismDriver.post_fork_initialize of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7325bc8967b0>> process after_init 55550000, True {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.271605 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNMechanismDriver._add_segment_host_mapping_for_segment of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7325bc8967b0>> segment after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.271762 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNMechanismDriver.create_segment_provnet_port of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7325bc8967b0>> segment after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.271921 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNMechanismDriver.delete_segment_provnet_port of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7325bc8967b0>> segment after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.272128 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNMechanismDriver._validate_allowed_address_pairs of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7325bc8967b0>> allowed_address_pair before_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.272296 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNMechanismDriver._create_security_group_precommit of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7325bc8967b0>> security_group precommit_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.272455 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNMechanismDriver._update_security_group of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7325bc8967b0>> security_group after_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.272584 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNMechanismDriver._create_security_group of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7325bc8967b0>> security_group after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.272696 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNMechanismDriver._delete_security_group_precommit of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7325bc8967b0>> security_group precommit_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.272868 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNMechanismDriver._delete_security_group of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7325bc8967b0>> security_group after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.273005 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNMechanismDriver._create_sg_rule_precommit of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7325bc8967b0>> security_group_rule precommit_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.273147 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNMechanismDriver._process_sg_rule_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7325bc8967b0>> security_group_rule after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.273261 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNMechanismDriver._process_sg_rule_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7325bc8967b0>> security_group_rule before_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.273371 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNMechanismDriver._process_ag_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7325bc8967b0>> address_group after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.273488 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNMechanismDriver._process_ag_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7325bc8967b0>> address_group after_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.273678 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNMechanismDriver._process_ag_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7325bc8967b0>> address_group after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.273882 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.ovn.driver.OVNQosDriver object at 0x7325bc610a40>> qos_plugin after_init 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.274134 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNTrunkDriver.register of <neutron.services.trunk.drivers.ovn.trunk_driver.OVNTrunkDriver object at 0x7325bb210d40>> trunk_plugin after_init 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.274363 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.ovn.driver.OVNDriver object at 0x7325bb210d70>> logging-plugin after_init 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.275335 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.services.logapi.drivers.ovn.driver [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] OVN logging driver registered
Apr 07 19:34:55.276858 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.plugins.ml2.plugin [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=103723) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_log/helpers.py:77}}
Apr 07 19:34:55.277078 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb211040>> port after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.277166 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb211040>> port after_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.277326 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb211040>> port after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.277440 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb210f50>> subnet after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.277553 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb210f50>> subnet after_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.277669 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb210f50>> subnet after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.277783 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb210ef0>> network after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.277896 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb210ef0>> network after_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.278016 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb210ef0>> network after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.278132 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb210ec0>> security_group after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.278238 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb210ec0>> security_group after_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.278348 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb210ec0>> security_group after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.278458 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb210f20>> security_group_rule after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.278556 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb210f20>> security_group_rule after_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.278662 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb210f20>> security_group_rule after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.278773 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb210e30>> address_group after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.278880 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb210e30>> address_group after_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.279001 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7325bb210e30>> address_group after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.279118 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ML2 OVO RPC backend initialized. {{(pid=103723) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:117}}
Apr 07 19:34:55.280238 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.quota [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded quota_driver: <neutron.db.quota.driver_nolock.DbQuotaNoLockDriver object at 0x7325bb211df0>.
Apr 07 19:34:55.280347 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.plugin [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Modular L2 Plugin initialization complete
Apr 07 19:34:55.280448 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading services supported by the core plugin {{(pid=103723) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:170}}
Apr 07 19:34:55.280551 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.plugins.ml2.managers [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Got port-security extension from driver 'port_security'
Apr 07 19:34:55.280829 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading service plugins: ['ovn-router', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=103723) _load_service_plugins /opt/stack/neutron/neutron/manager.py:195}}
Apr 07 19:34:55.280892 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading Plugin: ovn-router
Apr 07 19:34:55.290245 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method ExtraGatewaysDbOnlyMixin._delete_router_remove_external_gateways of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x7325bb2126f0>> router before_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.290364 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x7325bc9af380> port after_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.290463 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x7325bc9af240> port after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.290548 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x7325bc9af2e0> subnet after_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.290613 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x7325bc9af420> subnetpool_address_scope after_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.290721 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <function OVNL3RouterPlugin._port_update at 0x7325bbaf2020> port before_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.290787 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <function OVNL3RouterPlugin._port_update at 0x7325bbaf2020> port after_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.290869 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x7325bb2126f0>> port precommit_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.290969 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip at 0x7325bc9972e0> port before_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.291098 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x7325bc997240> port before_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.291153 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x7325bb2126f0>> router precommit_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.291246 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method ExtraGatewaysDbOnlyMixin._process_bfd_ecmp_create of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x7325bb2126f0>> router precommit_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.291326 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method ExtraGatewaysDbOnlyMixin._process_bfd_ecmp_update of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x7325bb2126f0>> router precommit_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.291413 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <function OVNL3RouterPlugin._subnet_update at 0x7325bbaf1f80> subnet after_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.292119 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.quota.resource_registry [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Tracking information for resource: router configured {{(pid=103723) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 07 19:34:55.292190 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.quota.resource_registry [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Tracking information for resource: floatingip configured {{(pid=103723) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 07 19:34:55.292250 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.services.ovn_l3.plugin [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Starting OVNL3RouterPlugin
Apr 07 19:34:55.292475 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNPortForwarding.register of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x7325bcd6f800>> port_forwarding_plugin after_init 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.292648 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x7325bb212090>> router before_create 55550100, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.292733 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x7325bb212090>> router precommit_delete 55550100, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.292852 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x7325bb212090>> router precommit_create 55550100, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.292921 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x7325bb212090>> router precommit_update 55550100, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.295573 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.services.provider_configuration [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Service providers = [] {{(pid=103723) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:170}}
Apr 07 19:34:55.295658 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.db.servicetype_db [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=103723) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
Apr 07 19:34:55.296955 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVN_L3_HA_db_mixin._precommit_router_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7325bbadecc0>> router precommit_create 55549900, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.297144 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OvnDriver._process_add_router_interface of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7325bbadecc0>> router_interface after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.297144 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OvnDriver._process_floatingip_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7325bbadecc0>> floatingip after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.297294 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OvnDriver._process_floatingip_create_update_precommit of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7325bbadecc0>> floatingip precommit_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.297294 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OvnDriver._process_floatingip_create_update_precommit of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7325bbadecc0>> floatingip precommit_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.297483 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OvnDriver._process_floatingip_delete of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7325bbadecc0>> floatingip after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.297483 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OvnDriver._process_floatingip_status_update of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7325bbadecc0>> floatingip after_status_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.297483 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OvnDriver._process_floatingip_update of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7325bbadecc0>> floatingip after_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.297691 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OvnDriver._process_portforwarding_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7325bbadecc0>> port_forwarding after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.297691 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OvnDriver._process_remove_router_interface of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7325bbadecc0>> router_interface after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.297840 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OvnDriver._process_router_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7325bbadecc0>> router after_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.297840 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OvnDriver._process_router_create_precommit of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7325bbadecc0>> router precommit_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.297963 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OvnDriver._process_router_delete of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7325bbadecc0>> router after_delete 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.297963 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OvnDriver._process_router_update of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7325bbadecc0>> router after_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.298116 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.services.service_base [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded 'neutron.services.ovn_l3.service_providers.ovn.OvnDriver' provider for service L3_ROUTER_NAT {{(pid=103723) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Apr 07 19:34:55.298179 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <bound method OVNL3RouterPlugin._post_fork_initialize of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x7325bb2126f0>> process after_init 55550001, True {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.298260 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding using OVN {{(pid=103723) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 07 19:34:55.298327 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading Plugin: auto_allocate
Apr 07 19:34:55.299193 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7325bb2b8360> network precommit_update 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.299286 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron_lib.callbacks.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7325bb2b8360> network precommit_create 55550000, False {{(pid=103723) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.299430 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=103723) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 07 19:34:55.299521 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading Plugin: tag
Apr 07 19:34:55.301783 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=103723) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 07 19:34:55.301874 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading Plugin: timestamp
Apr 07 19:34:55.302953 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=103723) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 07 19:34:55.303064 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading Plugin: network_ip_availability
Apr 07 19:34:55.304423 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=103723) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 07 19:34:55.304423 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading Plugin: flavors
Apr 07 19:34:55.305260 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=103723) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 07 19:34:55.305402 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading Plugin: revisions
Apr 07 19:34:55.306183 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.manager [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=103723) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 07 19:34:55.306270 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG oslo_concurrency.lockutils [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.651s {{(pid=103723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 07 19:34:55.306491 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] get_extension_paths = OrderedDict({'/opt/stack/neutron/neutron/extensions': 1}) {{(pid=103723) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}}
Apr 07 19:34:55.306612 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Initializing extension manager.
Apr 07 19:34:55.306787 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: __init__.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.306868 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: __pycache__ {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.306954 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: address_group.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.307282 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.307527 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: address-group
Apr 07 19:34:55.307527 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: address_scope.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.307839 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.308029 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: address-scope
Apr 07 19:34:55.308110 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: admin_state_down_before_update.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.308281 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.308421 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension router-admin-state-down-before-update not supported by any of loaded plugins
Apr 07 19:34:55.308497 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: agent.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.309027 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.309027 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: agent
Apr 07 19:34:55.309027 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: agent_resources_synced.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.309297 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.309617 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension agent-resources-synced not supported by any of loaded plugins
Apr 07 19:34:55.309696 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: allowedaddresspairs.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.310238 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.310383 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: allowed-address-pairs
Apr 07 19:34:55.310444 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: auto_allocated_topology.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.310657 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.310796 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: auto-allocated-topology
Apr 07 19:34:55.310862 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: availability_zone.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.311113 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.311246 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: availability_zone
Apr 07 19:34:55.311303 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: availability_zone_filter.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.311527 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.311649 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension availability_zone_filter not supported by any of loaded plugins
Apr 07 19:34:55.311704 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: data_plane_status.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.311904 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.312079 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension data-plane-status not supported by any of loaded plugins
Apr 07 19:34:55.312160 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: default_subnetpools.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.312332 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.312471 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: default-subnetpools
Apr 07 19:34:55.312525 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: dhcpagentscheduler.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.312911 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.313060 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: dhcp_agent_scheduler
Apr 07 19:34:55.313171 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: dns.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.313346 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.313485 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: dns-integration
Apr 07 19:34:55.313541 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: dns_domain_ports.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.313740 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.313870 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: dns-domain-ports
Apr 07 19:34:55.313926 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.314148 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like <project_id>, <project_name>, <user_id> and <user_name> as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.314271 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: dns-integration-domain-keywords
Apr 07 19:34:55.314346 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: dvr.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.314558 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.314688 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension dvr not supported by any of loaded plugins
Apr 07 19:34:55.314744 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: ecmp_routes.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.314940 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.315093 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension ecmp_routes not supported by any of loaded plugins
Apr 07 19:34:55.315150 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: empty_string_filtering.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.315344 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.315476 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: empty-string-filtering
Apr 07 19:34:55.315538 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.315726 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.315859 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
Apr 07 19:34:55.315915 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.316127 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.316261 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
Apr 07 19:34:55.316315 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: external_net.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.316510 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.316642 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: external-net
Apr 07 19:34:55.316697 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: extra_dhcp_opt.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.316909 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.317059 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: extra_dhcp_opt
Apr 07 19:34:55.317115 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: extraroute.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.317309 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.317440 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: extraroute
Apr 07 19:34:55.317513 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: extraroute_atomic.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.317706 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.317840 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: extraroute-atomic
Apr 07 19:34:55.317913 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: filter_validation.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.318127 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.318263 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: filter-validation
Apr 07 19:34:55.318335 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: fip_pf_description.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.318513 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.318646 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
Apr 07 19:34:55.318717 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: fip_pf_detail.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.318898 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Floating IP port forwarding detail" alias="floating-ip-port-forwarding-detail" description="Allow list floating ip return more port forwarding data, include'id' and 'internal_port_id'" updated="2022-05-06T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.319080 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: floating-ip-port-forwarding-detail
Apr 07 19:34:55.319167 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: fip_pf_port_range.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.319361 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Floating IP Port Forwarding support port ranges" alias="floating-ip-port-forwarding-port-ranges" description="Add support to port ranges" updated="2020-07-01T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.319500 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension floating-ip-port-forwarding-port-ranges not supported by any of loaded plugins
Apr 07 19:34:55.319581 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: fip_port_details.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.319906 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.320134 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: fip-port-details
Apr 07 19:34:55.320134 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: flavors.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.320380 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.320527 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: flavors
Apr 07 19:34:55.320631 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.320903 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.321034 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
Apr 07 19:34:55.321101 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: floatingip_pools.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.321360 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.321495 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: floatingip-pools
Apr 07 19:34:55.321566 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: ip_allocation.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.321759 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.321966 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension ip_allocation not supported by any of loaded plugins
Apr 07 19:34:55.322072 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: ip_substring_port_filtering.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.322457 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.322457 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension ip-substring-filtering not supported by any of loaded plugins
Apr 07 19:34:55.322457 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: l2_adjacency.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.322707 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.322771 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension l2_adjacency not supported by any of loaded plugins
Apr 07 19:34:55.322900 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: l3.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.323341 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.323461 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: router
Apr 07 19:34:55.323556 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: l3_conntrack_helper.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.324174 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.324297 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension l3-conntrack-helper not supported by any of loaded plugins
Apr 07 19:34:55.324362 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: l3_enable_default_route_bfd.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.324599 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Enable Default Route BFD" alias="enable-default-route-bfd" description="Enables configurable BFD behavior for default routes" updated="2023-02-27T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.324717 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: enable-default-route-bfd
Apr 07 19:34:55.324870 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: l3_enable_default_route_ecmp.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.325131 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Enable Default Route ECMP" alias="enable-default-route-ecmp" description="Enables configurable ECMP behavior for default routes" updated="2023-02-27T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.325283 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: enable-default-route-ecmp
Apr 07 19:34:55.325415 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: l3_ext_gw_mode.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.325591 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.325758 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: ext-gw-mode
Apr 07 19:34:55.325758 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: l3_ext_ha_mode.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.326044 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.326194 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: l3-ha
Apr 07 19:34:55.326278 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: l3_ext_ndp_proxy.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.326431 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Router support to enable NDP proxy" alias="l3-ext-ndp-proxy" description="Router extension to enable ndp proxy" updated="2020-08-25T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.326561 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension l3-ext-ndp-proxy not supported by any of loaded plugins
Apr 07 19:34:55.326659 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: l3_extra_gws.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.326816 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Neutron L3 External Gateway Multihoming" alias="external-gateway-multihoming" description="Allow multiple external gateway ports per router" updated="2023-01-18T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.326954 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: external-gateway-multihoming
Apr 07 19:34:55.327066 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: l3_flavors.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.327280 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.327423 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: l3-flavors
Apr 07 19:34:55.327504 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: l3_ndp_proxy.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.327713 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="name" alias="l3-ndp-proxy" description="description" updated="2021-06-29T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.327868 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension l3-ndp-proxy not supported by any of loaded plugins
Apr 07 19:34:55.327943 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.328132 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.328268 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension l3-port-ip-change-not-allowed not supported by any of loaded plugins
Apr 07 19:34:55.328348 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: l3agentscheduler.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.328862 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.328965 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension l3_agent_scheduler not supported by any of loaded plugins
Apr 07 19:34:55.329116 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: local_ip.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.329396 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.329594 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension local_ip not supported by any of loaded plugins
Apr 07 19:34:55.329594 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: logging.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.329951 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.330106 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension logging not supported by any of loaded plugins
Apr 07 19:34:55.330174 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: metering.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.331966 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.332141 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension metering not supported by any of loaded plugins
Apr 07 19:34:55.332222 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.332502 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.332649 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension metering_source_and_destination_fields not supported by any of loaded plugins
Apr 07 19:34:55.332718 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: multiprovidernet.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.332944 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.333125 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: multi-provider
Apr 07 19:34:55.333206 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: netmtu.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.333400 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.333628 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: net-mtu
Apr 07 19:34:55.333707 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: netmtu_writable.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.333898 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.334074 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: net-mtu-writable
Apr 07 19:34:55.334149 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: network_availability_zone.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.334362 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.334503 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: network_availability_zone
Apr 07 19:34:55.334573 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: network_ha.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.334760 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Network HA creation flag" alias="network_ha" description="Network high availability creation flag." updated="2023-04-27T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.334895 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension network_ha not supported by any of loaded plugins
Apr 07 19:34:55.334972 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: network_ip_availability.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.335203 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.335341 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: network-ip-availability
Apr 07 19:34:55.335421 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: network_ip_availability_details.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.335620 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Network IP Availability Details Extension" alias="network-ip-availability-details" description="Add ip_availability_details attribute to network-ip-availabilities resource." updated="2025-10-31T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.335757 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: network-ip-availability-details
Apr 07 19:34:55.335832 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: network_segment_range.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.336131 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.336274 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension network-segment-range not supported by any of loaded plugins
Apr 07 19:34:55.336343 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: pagination.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.336544 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.336623 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: pagination
Apr 07 19:34:55.336690 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: port_device_profile.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.336922 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.337097 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: port-device-profile
Apr 07 19:34:55.337166 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: port_hardware_offload_type.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.337365 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Port hardware offload" alias="port-hardware-offload-type" description="Expose port hardware offload extension" updated="2023-05-09T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.337505 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension port-hardware-offload-type not supported by any of loaded plugins
Apr 07 19:34:55.337587 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: port_hint_ovs_tx_steering.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.337767 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Port hint: Open vSwitch Tx steering" alias="port-hint-ovs-tx-steering" description="Enable Port hint: Open vSwitch Tx steering" updated="2023-01-01T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.337942 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension port-hint-ovs-tx-steering not supported by any of loaded plugins
Apr 07 19:34:55.338036 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: port_hints.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.338251 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Port hints" alias="port-hints" description="Backend specific port hints to allow backend specific tuning" updated="2023-01-01T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.338395 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension port-hints not supported by any of loaded plugins
Apr 07 19:34:55.338462 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: port_mac_address_override.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.338652 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Neutron Port MAC address override" alias="port-mac-override" description="Allow overriding the MAC address of a direct-physical Port via the active binding profile" updated="2022-03-18T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.338789 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension port-mac-override not supported by any of loaded plugins
Apr 07 19:34:55.338843 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: port_mac_address_regenerate.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.339088 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.339231 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: port-mac-address-regenerate
Apr 07 19:34:55.339314 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: port_numa_affinity_policy.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.339494 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.339632 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: port-numa-affinity-policy
Apr 07 19:34:55.339688 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: port_numa_affinity_policy_socket.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.339889 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Port NUMA affinity policy "socket"" alias="port-numa-affinity-policy-socket" description="Adds "socket" to the supported port NUMA affinity policies" updated="2024-02-09T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.340058 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: port-numa-affinity-policy-socket
Apr 07 19:34:55.340130 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: port_resource_request.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.340320 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.340457 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension port-resource-request not supported by any of loaded plugins
Apr 07 19:34:55.340526 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: port_resource_request_groups.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.340726 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.340882 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension port-resource-request-groups not supported by any of loaded plugins
Apr 07 19:34:55.340958 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: port_trusted_vif.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.341188 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Port trusted vif" alias="port-trusted-vif" description="Expose port 'trusted' attribute in the API" updated="2024-07-10T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.341327 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension port-trusted-vif not supported by any of loaded plugins
Apr 07 19:34:55.341397 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: portbindings.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.341583 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.341720 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: binding
Apr 07 19:34:55.341791 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: portbindings_extended.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.342027 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.342170 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: binding-extended
Apr 07 19:34:55.342235 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: portsecurity.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.342431 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.342566 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: port-security
Apr 07 19:34:55.342637 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: project_id.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.342827 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.342913 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: project-id
Apr 07 19:34:55.342959 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: providernet.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.343182 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.343323 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: provider
Apr 07 19:34:55.343382 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: qinq.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.343622 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="QinQ networks" alias="qinq" description="Expose network 'qinq' attribute in the API. This allows to configure network to allow vlan in vlan configuration using 0x8a88 ethertype (QinQ)." updated="2024-12-02T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.343788 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: qinq
Apr 07 19:34:55.343901 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: qos.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.344889 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.345078 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension qos not supported by any of loaded plugins
Apr 07 19:34:55.345155 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: qos_bw_limit_direction.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.345430 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.345601 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
Apr 07 19:34:55.345671 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.346178 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.346347 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
Apr 07 19:34:55.346436 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: qos_default.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.346716 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.346852 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension qos-default not supported by any of loaded plugins
Apr 07 19:34:55.347018 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: qos_fip.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.347229 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.347440 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension qos-fip not supported by any of loaded plugins
Apr 07 19:34:55.347517 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: qos_fip_network_policy.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.347718 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="QoS floating IP network policy ID" alias="qos-fip-network-policy" description="Adds a the QoS network ID to the floating IP definition" updated="2021-11-15T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.347920 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension qos-fip-network-policy not supported by any of loaded plugins
Apr 07 19:34:55.348022 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: qos_gateway_ip.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.348265 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.348397 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension qos-gateway-ip not supported by any of loaded plugins
Apr 07 19:34:55.348473 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: qos_port_network_policy.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.348658 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.349046 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension qos-port-network-policy not supported by any of loaded plugins
Apr 07 19:34:55.349131 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.349342 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.349487 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension qos-pps-minimum not supported by any of loaded plugins
Apr 07 19:34:55.349556 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: qos_pps_minimum_rule_alias.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.349761 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="QoS minimum packet rate rule alias" alias="qos-pps-minimum-rule-alias" description="API to enable GET, PUT and DELETE operations on QoS minimum packet rate rule without specifying policy ID" updated="2021-10-22T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.349894 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension qos-pps-minimum-rule-alias not supported by any of loaded plugins
Apr 07 19:34:55.349969 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: qos_pps_rule.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.350219 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.350350 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension qos-pps not supported by any of loaded plugins
Apr 07 19:34:55.350425 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: qos_rule_type_details.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.350654 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.350747 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension qos-rule-type-details not supported by any of loaded plugins
Apr 07 19:34:55.350831 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: qos_rule_type_filter.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.351059 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Allow to filter the list of QoS rule types" alias="qos-rule-type-filter" description="Allows to filter the QoS rule type list adding two new flags. "all_rules" prints all implemented QoS rule types."all_supported" prints all supported QoS rule types by the loaded mechanism drivers" updated="2022-02-02T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.351220 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension qos-rule-type-filter not supported by any of loaded plugins
Apr 07 19:34:55.351297 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: qos_rules_alias.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.351490 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.351624 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension qos-rules-alias not supported by any of loaded plugins
Apr 07 19:34:55.351702 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: quota_check_limit.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.351874 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.352033 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: quota-check-limit
Apr 07 19:34:55.352113 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: quota_check_limit_default.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.352311 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Quota engine limit check by default" alias="quota-check-limit-default" description="By default, the Neutron quota engine checks the resource usage before applying a new quota limit" updated="2024-08-21T16:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.352444 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: quota-check-limit-default
Apr 07 19:34:55.352518 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: quotasv2.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.353290 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.353346 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: quotas
Apr 07 19:34:55.353443 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: quotasv2_detail.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.353730 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.353799 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: quota_details
Apr 07 19:34:55.353877 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: rbac.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.354363 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.354509 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: rbac-policies
Apr 07 19:34:55.354580 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: rbac_address_group.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.354778 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.354909 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension rbac-address-group not supported by any of loaded plugins
Apr 07 19:34:55.355007 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: rbac_address_scope.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.355196 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.355324 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: rbac-address-scope
Apr 07 19:34:55.355404 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: rbac_security_groups.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.355595 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.355771 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: rbac-security-groups
Apr 07 19:34:55.355864 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: rbac_subnetpool.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.356073 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.356208 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension rbac-subnetpool not supported by any of loaded plugins
Apr 07 19:34:55.356286 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: revisionifmatch.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.356485 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.356641 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: revision-if-match
Apr 07 19:34:55.356715 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: revisions.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.356958 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.357116 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: standard-attr-revisions
Apr 07 19:34:55.357195 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: router_availability_zone.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.357416 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.357563 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: router_availability_zone
Apr 07 19:34:55.357643 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: router_enable_snat.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.357818 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Exposes the router "enable_snat" read-only configuration flag" alias="router-enable-snat" description="Exposes the router "enable_snat" read-only configuration flag" updated="2025-09-18T18:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.357960 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: router-enable-snat
Apr 07 19:34:55.358056 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: routerservicetype.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.358235 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.358372 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension router-service-type not supported by any of loaded plugins
Apr 07 19:34:55.358451 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: security_groups_default_rules.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.358818 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Default rules for security groups" alias="security-groups-default-rules" description="Configure set of security group rules used as default rules for every new security group" updated="2022-12-19T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.358956 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: security-groups-default-rules
Apr 07 19:34:55.359038 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.359241 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.359372 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: security-groups-normalized-cidr
Apr 07 19:34:55.359442 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: security_groups_port_filtering.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.359633 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.359764 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension port-security-groups-filtering not supported by any of loaded plugins
Apr 07 19:34:55.359842 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: security_groups_remote_address_group.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.360044 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.360173 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: security-groups-remote-address-group
Apr 07 19:34:55.360251 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: security_groups_rules_belongs_to_default_sg.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.360429 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Security group rule belongs to the project's default security group" alias="security-groups-rules-belongs-to-default-sg" description="Flag to determine if the security group rule belongs to the project's default security group" updated="2023-05-23T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.360566 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: security-groups-rules-belongs-to-default-sg
Apr 07 19:34:55.360629 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: security_groups_shared_filtering.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.360840 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.361004 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: security-groups-shared-filtering
Apr 07 19:34:55.361087 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: securitygroup.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.362607 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.362755 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: security-group
Apr 07 19:34:55.362812 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: segment.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.363320 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.363517 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension segment not supported by any of loaded plugins
Apr 07 19:34:55.363639 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.363830 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.364014 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
Apr 07 19:34:55.364130 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: servicetype.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.364392 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.364567 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: service-type
Apr 07 19:34:55.364668 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: sorting.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.364907 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.365041 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: sorting
Apr 07 19:34:55.365091 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: standard_attr_segment.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.365293 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.365465 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension standard-attr-segment not supported by any of loaded plugins
Apr 07 19:34:55.365569 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: standardattrdescription.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.365773 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.365916 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: standard-attr-description
Apr 07 19:34:55.366007 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: stateful_security_group.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.366214 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.366361 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: stateful-security-group
Apr 07 19:34:55.366416 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: stdattrs_common.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.366611 np0000164077 neutron-ovn-maintenance-worker[103723]: WARNING neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
Apr 07 19:34:55.366685 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.366908 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.367263 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: subnet-dns-publish-fixed-ip
Apr 07 19:34:55.367364 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: subnet_external_network.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.367608 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Subnet belongs to an external network" alias="subnet-external-network" description="Informs if the subnet belongs to an external network" updated="2024-02-05T18:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.367775 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: subnet-external-network
Apr 07 19:34:55.367854 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: subnet_onboard.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.368286 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.368433 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension subnet_onboard not supported by any of loaded plugins
Apr 07 19:34:55.368485 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: subnet_segmentid_writable.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.368702 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.368877 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
Apr 07 19:34:55.368971 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: subnet_service_types.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.369181 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.369315 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: subnet-service-types
Apr 07 19:34:55.369390 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: subnetallocation.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.369595 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.369727 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: subnet_allocation
Apr 07 19:34:55.369799 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.370057 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.370192 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: subnetpool-prefix-ops
Apr 07 19:34:55.370269 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: tag_creation.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.370459 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Tag creation extension" alias="tag-creation" description="Allow to create multiple tags for a resource" updated="2024-23-07T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.370596 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: tag-creation
Apr 07 19:34:55.370669 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.370852 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.371091 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
Apr 07 19:34:55.371091 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: tagging.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.371860 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.372040 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: standard-attr-tag
Apr 07 19:34:55.372115 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: timestamp.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.372320 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.372465 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: standard-attr-timestamp
Apr 07 19:34:55.372547 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: trunk.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.372726 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.372883 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension trunk not supported by any of loaded plugins
Apr 07 19:34:55.372963 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: trunk_details.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.373183 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.373325 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension trunk-details not supported by any of loaded plugins
Apr 07 19:34:55.373380 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: uplink_status_propagation.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.373576 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.373703 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension uplink-status-propagation not supported by any of loaded plugins
Apr 07 19:34:55.373775 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: uplink_status_propagation_updatable.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.373963 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Uplink status propagation updatable extension" alias="uplink-status-propagation-updatable" description="Provides ability to update the port uplink status." updated="2024-09-03T18:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.374120 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Extension uplink-status-propagation-updatable not supported by any of loaded plugins
Apr 07 19:34:55.374176 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loading extension file: vlantransparent.py {{(pid=103723) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 07 19:34:55.374402 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=103723) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 07 19:34:55.374540 np0000164077 neutron-ovn-maintenance-worker[103723]: INFO neutron.api.extensions [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Loaded extension: vlan-transparent
Apr 07 19:34:55.377290 np0000164077 neutron-ovn-maintenance-worker[103723]: WARNING oslo_service.backend._threading.service [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Service MaintenanceWorker is not picklable with spawn; falling back to fork. Please make the service spawn-safe to avoid this fallback.
Apr 07 19:34:55.377608 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Full set of CONF: {{(pid=103723) _load_service_manager_options /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/oslo_config_glue.py:59}}
Apr 07 19:34:55.377668 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ******************************************************************************** {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 07 19:34:55.377737 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Configuration options gathered from: {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 07 19:34:55.377796 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 07 19:34:55.377893 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 07 19:34:55.377946 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ================================================================================ {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 07 19:34:55.378099 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] agent_down_time                = 75 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.378220 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] allow_automatic_dhcp_failover  = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.378331 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] allow_bulk                     = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.378515 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.378620 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] api_extensions_path            =  {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.378693 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] api_paste_config               = api-paste.ini {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.378787 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] api_workers                    = 4 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.378882 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] auth_strategy                  = keystone {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.378973 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] backlog                        = 4096 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.379086 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] base_mac                       = fa:16:3e:00:00:00 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.379195 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] bind_host                      = 0.0.0.0 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.379284 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] bind_port                      = 9696 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.379370 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] client_socket_timeout          = 900 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.379446 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] config_dir                     = [] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.379534 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.379625 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] config_source                  = [] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.379709 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] control_exchange               = neutron {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.379800 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] core_plugin                    = ml2 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.379890 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] debug                          = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.380005 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] default_availability_zones     = [] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.380194 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.380301 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] dhcp_agent_notification        = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.380407 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] dhcp_agents_per_network        = 1 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.380460 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] dhcp_lease_duration            = 86400 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.380539 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] dhcp_load_type                 = networks {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.380651 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] dns_domain                     = openstacklocal {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.380733 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.380848 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] enable_default_route_bfd       = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.380938 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] enable_default_route_ecmp      = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.381035 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] enable_dvr                     = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.381134 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] enable_new_agents              = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.381221 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] enable_services_on_agents_with_admin_state_down = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.381304 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] enable_snat_by_default         = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.381375 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] enable_traditional_dhcp        = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.381456 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] external_dns_driver            = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.381553 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] filter_validation              = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.381627 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] global_physnet_mtu             = 1430 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.381674 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] graceful_shutdown_timeout      = 60 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.381835 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] host                           = np0000164077 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.381922 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] host_dvr_for_dhcp              = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.382027 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] http_retries                   = 3 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.382105 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] instance_format                = [instance: %(uuid)s]  {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.382197 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.382285 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ipam_driver                    = internal {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.382381 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ipv6_pd_enabled                = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.382435 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] l3_ha                          = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.382532 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.382656 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] l3_ha_network_physical_name    =  {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.382761 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] l3_ha_network_type             =  {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.382856 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] log_color                      = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.382955 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] log_config_append              = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.383094 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.383170 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] log_dir                        = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.383255 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] log_file                       = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.383309 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] log_options                    = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.383415 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] log_rotate_interval            = 1 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.383510 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] log_rotate_interval_type       = days {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.383615 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] log_rotation_type              = none {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.383667 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.383722 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.383825 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.383937 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.384008 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.384064 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] max_allowed_address_pair       = 10 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.384164 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] max_dns_nameservers            = 5 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.384249 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] max_header_line                = 16384 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.384331 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] max_l3_agents_per_router       = 3 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.384422 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] max_logfile_count              = 30 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.384489 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] max_logfile_size_mb            = 200 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.384576 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] max_routes                     = 30 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.384651 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] max_subnet_host_routes         = 20 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.384743 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] my_ip                          = 199.204.45.248 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.384842 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] my_ipv6                        = 2604:e100:1:0:f816:3eff:fe1e:6c21 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.384942 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] network_auto_schedule          = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.385044 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] network_link_prefix            = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.385106 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.385213 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] notify_nova_on_port_data_changes = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.385301 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] notify_nova_on_port_status_changes = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.385389 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] pagination_max_limit           = -1 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.385508 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] periodic_fuzzy_delay           = 5 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.385567 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] periodic_interval              = 40 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.385646 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] publish_errors                 = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.385724 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] rate_limit_burst               = 0 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.385857 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] rate_limit_except_level        = CRITICAL {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.385906 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] rate_limit_interval            = 0 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.386000 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] retry_until_window             = 30 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.386085 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] router_distributed             = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.386174 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] rpc_resources_processing_step  = 20 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.386245 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] rpc_response_max_timeout       = 600 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.386337 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] rpc_response_timeout           = 60 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.386435 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] rpc_state_report_workers       = 0 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.386507 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] rpc_workers                    = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.386589 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] send_events_interval           = 2 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.386674 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] service_plugins                = ['ovn-router'] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.386769 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] setproctitle                   = on {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.386856 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] shell_completion               = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.386938 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] state_path                     = /opt/stack/data/neutron {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.387048 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] syslog_log_facility            = LOG_USER {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.387102 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] tcp_keepidle                   = 600 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.387216 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] transport_url                  = **** {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.387283 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] use_journal                    = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.387410 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] use_json                       = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.387524 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] use_ssl                        = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.387576 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] use_stderr                     = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.387656 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] use_syslog                     = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.387780 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] vlan_qinq                      = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.387780 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] vlan_transparent               = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.387917 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] wsgi_default_pool_size         = 100 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.387965 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] wsgi_keep_alive                = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.388081 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.388135 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] wsgi_server_debug              = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.388251 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_concurrency.disable_process_locking = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.388331 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.388429 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] profiler.connection_string     = messaging:// {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.388533 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] profiler.enabled               = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.388615 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] profiler.es_doc_type           = notification {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.388691 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] profiler.es_scroll_size        = 10000 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.388876 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] profiler.es_scroll_time        = 2m {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.388876 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] profiler.filter_error_trace    = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.389117 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] profiler.hmac_keys             = **** {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.389117 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] profiler.sentinel_service_name = mymaster {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.389444 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] profiler.socket_timeout        = 0.1 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.389444 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] profiler.trace_requests        = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.389444 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] profiler.trace_sqlalchemy      = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.389557 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] profiler_jaeger.process_tags   = {} {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.389589 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] profiler_jaeger.service_name_prefix = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.389688 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] profiler_otlp.service_name_prefix = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.389779 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.389870 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.389958 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.390070 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.390157 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.390257 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_policy.enforce_new_defaults = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.390451 np0000164077 neutron-ovn-maintenance-worker[103723]: WARNING oslo_config.cfg [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 07 19:34:55.390540 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_policy.enforce_scope      = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.390636 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_policy.policy_default_rule = default {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.390738 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.390831 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.390925 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.391025 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.391115 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.391200 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.391293 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.391378 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_policy.remote_timeout     = 60.0 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.391477 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.391571 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] service_providers.service_provider = [] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.391670 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.auth_section              = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.391767 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.auth_type                 = password {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.391861 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.auth_url                  = https://199.204.45.248/identity {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.391947 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.cafile                    = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.392051 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.certfile                  = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.392143 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.collect_timing            = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.392230 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.default_domain_id         = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.392318 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.default_domain_name       = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.392407 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.domain_id                 = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.392491 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.domain_name               = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.392584 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.endpoint_type             = public {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.392673 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.insecure                  = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.392758 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.keyfile                   = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.392886 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.password                  = **** {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.392971 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.project_domain_id         = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.393079 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.project_domain_name       = Default {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.393179 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.project_id                = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.393302 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.project_name              = service {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.393302 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.region_name               = RegionOne {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.393302 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.split_loggers             = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.393633 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.system_scope              = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.393673 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.timeout                   = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.393769 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.trust_id                  = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.393841 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.user_domain_id            = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.393938 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.user_domain_name          = Default {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.394047 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.user_id                   = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.394140 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] nova.username                  = nova {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.394249 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] placement.auth_section         = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.394351 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] placement.auth_type            = password {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.394439 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] placement.cafile               = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.394525 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] placement.certfile             = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.394608 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] placement.collect_timing       = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.394704 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] placement.endpoint_type        = public {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.394789 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] placement.insecure             = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.394919 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] placement.keyfile              = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.395058 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] placement.region_name          = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.395058 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] placement.split_loggers        = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.395200 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] placement.timeout              = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.395200 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.auth_section            = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.395304 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.auth_type               = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.395390 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.cafile                  = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.395499 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.certfile                = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.395616 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.collect_timing          = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.395726 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.connect_retries         = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.395820 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.connect_retry_delay     = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.395940 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.enable_notifications    = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.396021 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.endpoint_override       = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.396093 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.insecure                = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.396189 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.interface               = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.396273 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.keyfile                 = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.396359 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.max_version             = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.396445 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.min_version             = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.396529 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.region_name             = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.396633 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.retriable_status_codes  = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.396735 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.service_name            = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.396819 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.service_type            = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.396912 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.split_loggers           = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.396995 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.status_code_retries     = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.397089 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.status_code_retry_delay = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.397174 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.timeout                 = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.397260 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.valid_interfaces        = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.397354 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ironic.version                 = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.397447 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] cli_script.dry_run             = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.397549 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.397626 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.397737 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.397820 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.397888 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.397976 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.398086 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.398169 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.398259 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.398372 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.hostname = np0000164077 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.398469 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.398632 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.398727 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.398812 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.399112 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.399238 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.processname = neutron-ovn-maintenance-worker {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.399331 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.399421 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.399517 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.399606 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.399693 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.399775 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.399866 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.399952 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.400051 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.400142 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.400230 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.400318 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.400405 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.400492 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.400579 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.ssl      = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.400685 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.400801 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.400891 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.401005 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.401078 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.ssl_version =  {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.401170 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.401260 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_notifications.driver = [] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.401346 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_notifications.retry = -1 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.401509 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.401509 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_messaging_notifications.transport_url = **** {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.401596 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_reports.file_event_handler = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.401708 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_reports.file_event_handler_interval = 1 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.401777 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_reports.log_dir           = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.401870 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.401972 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] QUOTAS.default_quota           = -1 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.402076 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] QUOTAS.quota_driver            = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.402165 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] QUOTAS.quota_floatingip        = 50 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.402253 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] QUOTAS.quota_network           = 100 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.402341 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] QUOTAS.quota_port              = 500 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.402428 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] QUOTAS.quota_rbac_policy       = 10 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.402515 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] QUOTAS.quota_router            = 10 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.402604 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] QUOTAS.quota_security_group    = 10 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.402690 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] QUOTAS.quota_security_group_rule = 100 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.402770 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] QUOTAS.quota_subnet            = 100 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.402922 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] QUOTAS.track_quota_usage       = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.402975 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.403446 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep.group                  = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.403517 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep.helper_command         = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.403571 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep.log_daemon_traceback   = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.403662 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep.logger_name            = oslo_privsep.daemon {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.403750 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep.thread_pool_size       = 16 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.404035 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep.user                   = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.404035 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.404170 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_dhcp_release.group     = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.404170 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_dhcp_release.helper_command = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.404332 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.404386 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.404460 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_dhcp_release.thread_pool_size = 16 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.404557 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_dhcp_release.user      = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.404638 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.404684 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_ovs_vsctl.group        = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.404822 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_ovs_vsctl.helper_command = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.404882 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.404951 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_ovs_vsctl.logger_name  = oslo_privsep.daemon {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.405067 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_ovs_vsctl.thread_pool_size = 16 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.405142 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_ovs_vsctl.user         = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.405239 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_namespace.capabilities = [21] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.405311 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_namespace.group        = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.405399 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_namespace.helper_command = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.405483 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_namespace.log_daemon_traceback = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.405572 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_namespace.logger_name  = oslo_privsep.daemon {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.405658 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_namespace.thread_pool_size = 16 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.405743 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_namespace.user         = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.405834 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_conntrack.capabilities = [12] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.405960 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_conntrack.group        = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.406070 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_conntrack.helper_command = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.406158 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_conntrack.log_daemon_traceback = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.406247 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_conntrack.logger_name  = oslo_privsep.daemon {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.406333 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_conntrack.thread_pool_size = 16 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.406417 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_conntrack.user         = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.406512 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_link.capabilities      = [12, 21] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.406599 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_link.group             = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.406682 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_link.helper_command    = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.406762 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_link.log_daemon_traceback = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.406845 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_link.logger_name       = oslo_privsep.daemon {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.406933 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_link.thread_pool_size  = 16 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.407219 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] privsep_link.user              = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.407508 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] AGENT.root_helper              = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.407562 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] AGENT.root_helper_daemon       = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.407647 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] AGENT.use_helper_for_ns_read   = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.407739 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] SECURITYGROUP.enable_ipset     = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.407872 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] SECURITYGROUP.enable_security_group = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.407908 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] SECURITYGROUP.firewall_driver  = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.408393 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.408393 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] experimental.ipv6_pd_enabled   = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.408393 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ml2.extension_drivers          = ['port_security', 'qos'] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.408393 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ml2.external_network_type      = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.408393 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ml2.mechanism_drivers          = ['ovn'] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.408537 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ml2.overlay_ip_version         = 4 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.408575 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ml2.path_mtu                   = 0 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.408700 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ml2.physical_network_mtus      = {} {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.408842 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ml2.project_network_types      = ['geneve'] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.409166 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ml2.tunnelled_network_rp_name  = rp_tunnelled {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.409287 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ml2.type_drivers               = ['local', 'flat', 'vlan', 'geneve'] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.409391 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ml2_type_flat.flat_networks    = ['public'] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.409491 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ml2_type_geneve.max_header_size = 38 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.409584 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ml2_type_geneve.vni_ranges     = ['1:65536'] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.409681 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ml2_type_vlan.network_vlan_ranges = ['public'] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.409776 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] network_log.burst_limit        = 25 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.409863 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] network_log.local_output_log_base = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.409950 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] network_log.rate_limit         = 100 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.410067 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.asyncio_connection    = **** {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.410149 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.asyncio_slave_connection = **** {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.410242 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.backend               = sqlalchemy {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.410333 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.connection            = **** {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.410421 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.connection_debug      = 0 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.410512 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.connection_parameters =  {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.410600 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.connection_recycle_time = 3600 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.410689 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.connection_trace      = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.410775 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.db_inc_retry_interval = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.410860 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.db_max_retries        = 20 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.410949 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.db_max_retry_interval = 10 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.411059 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.db_retry_interval     = 1 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.411148 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.max_overflow          = 50 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.411235 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.max_pool_size         = 5 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.411321 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.max_retries           = 10 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.411412 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.411497 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.mysql_wsrep_sync_wait = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.411580 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.pool_timeout          = None {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.411667 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.retry_interval        = 10 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.411753 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.slave_connection      = **** {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.411837 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.sqlite_synchronous    = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.411924 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.synchronous_reader    = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.412025 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] database.use_db_reconnect      = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.412127 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.bfd_min_rx                 = 1000 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.412214 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.bfd_min_tx                 = 100 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.412301 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.bfd_mult                   = 3 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.412390 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.broadcast_arps_to_all_routers = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.412475 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.dhcp_default_lease_time    = 43200 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.412564 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.412653 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.dns_records_ovn_owned      = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.412742 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.dns_servers                = [] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.412849 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.enable_distributed_floating_ip = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.412938 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.fdb_age_threshold          = 300 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.413051 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ha_failover_strategy       = normal {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.413145 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.live_migration_activation_strategy = rarp {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.413232 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.localnet_learn_fdb         = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.413319 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.mac_binding_age_threshold  = 300 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.413411 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.neutron_sync_mode          = log {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.413498 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovn_dhcp4_global_options   = {} {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.413587 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovn_dhcp6_global_options   = {} {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.413678 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovn_l3_scheduler           = leastloaded {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.413770 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovn_metadata_enabled       = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.413916 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovn_nb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.413969 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovn_nb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.414091 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovn_nb_connection          = ['ssl:199.204.45.248:6641'] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.414183 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovn_nb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.414272 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovn_router_indirect_snat   = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.414362 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovn_sb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.414453 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovn_sb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.414547 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovn_sb_connection          = ['ssl:199.204.45.248:6642'] {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.415288 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovn_sb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.415288 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovs_create_tap             = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.415288 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovsdb_connection_timeout   = 180 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.415288 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovsdb_log_level            = INFO {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.415288 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovsdb_probe_interval       = 60000 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.415288 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.ovsdb_retry_max_interval   = 180 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.415288 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.stateless_nat_enabled      = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.415815 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn.vhost_sock_dir             = /var/run/openvswitch {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.415815 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] OVS.bridge_mac_table_size      = 50000 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.415815 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] OVS.igmp_flood                 = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.415815 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] OVS.igmp_flood_reports         = True {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.415815 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] OVS.igmp_flood_unregistered    = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.415815 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] OVS.igmp_snooping_enable       = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.415815 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] OVS.ovsdb_timeout              = 10 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.416215 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn_nb_global.fdb_removal_limit = 0 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.416215 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn_nb_global.ignore_lsp_down  = False {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.416215 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.416215 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG cotyledon.oslo_config_glue [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] ******************************************************************************** {{(pid=103723) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 07 19:34:55.416215 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG oslo_service.backend._threading.service [None req-1b338586-90b4-4875-8fce-993060b6a4ef None None] Selected the multiprocessing context: <multiprocessing.context.ForkContext object at 0x7325c0ff2cf0> and updated it in Cotyledon ServiceManager: <multiprocessing.context.ForkContext object at 0x7325c0ff2cf0> {{(pid=103723) launch_service /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/service.py:394}}
Apr 07 19:34:55.451062 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] Full set of CONF: {{(pid=104575) _load_service_options /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/oslo_config_glue.py:65}}
Apr 07 19:34:55.451685 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ******************************************************************************** {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 07 19:34:55.451685 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] Configuration options gathered from: {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 07 19:34:55.451685 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 07 19:34:55.451820 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 07 19:34:55.451894 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ================================================================================ {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 07 19:34:55.452250 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] agent_down_time                = 75 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.452468 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] allow_automatic_dhcp_failover  = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.452676 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] allow_bulk                     = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.453085 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.453287 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] api_extensions_path            =  {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.453478 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] api_paste_config               = api-paste.ini {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.453706 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] api_workers                    = 4 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.453892 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] auth_strategy                  = keystone {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.454145 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] backlog                        = 4096 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.454344 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.454741 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] bind_host                      = 0.0.0.0 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.454956 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] bind_port                      = 9696 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.455192 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] client_socket_timeout          = 900 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.455398 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] config_dir                     = [] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.455518 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.455685 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] config_source                  = [] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.455877 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] control_exchange               = neutron {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.456091 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] core_plugin                    = ml2 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.456286 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] debug                          = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.456486 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] default_availability_zones     = [] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.456908 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.457140 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] dhcp_agent_notification        = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.457407 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] dhcp_agents_per_network        = 1 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.457474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] dhcp_lease_duration            = 86400 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.457583 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] dhcp_load_type                 = networks {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.457694 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] dns_domain                     = openstacklocal {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.457752 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.457838 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] enable_default_route_bfd       = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.457896 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] enable_default_route_ecmp      = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.458021 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] enable_dvr                     = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.458137 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] enable_new_agents              = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.458193 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] enable_services_on_agents_with_admin_state_down = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.458281 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] enable_snat_by_default         = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.458387 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] enable_traditional_dhcp        = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.458492 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] external_dns_driver            = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.458556 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] fatal_deprecations             = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.458646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] filter_validation              = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.458729 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] global_physnet_mtu             = 1430 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.458819 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] graceful_shutdown_timeout      = 60 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.459077 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] host                           = np0000164077 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.459191 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] host_dvr_for_dhcp              = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.459306 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] http_retries                   = 3 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.459408 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] instance_format                = [instance: %(uuid)s]  {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.459496 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.459553 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ipam_driver                    = internal {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.459648 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ipv6_pd_enabled                = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.459733 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] l3_ha                          = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.459821 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.459887 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_network_physical_name    =  {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.459938 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_network_type             =  {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.460052 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] log_color                      = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.460138 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] log_config_append              = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.460226 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.460311 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] log_dir                        = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.460311 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] log_file                       = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.460471 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] log_options                    = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.460471 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] log_rotate_interval            = 1 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.460581 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] log_rotate_interval_type       = days {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.460627 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] log_rotation_type              = none {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.460713 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.460816 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.460896 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.460997 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.460997 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.461239 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] max_allowed_address_pair       = 10 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.461239 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] max_dns_nameservers            = 5 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.461239 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] max_header_line                = 16384 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.461430 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] max_l3_agents_per_router       = 3 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.461430 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] max_logfile_count              = 30 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.461430 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] max_logfile_size_mb            = 200 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.461551 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] max_routes                     = 30 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.461551 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] max_subnet_host_routes         = 20 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.461643 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] my_ip                          = 199.204.45.248 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.461693 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] my_ipv6                        = 2604:e100:1:0:f816:3eff:fe1e:6c21 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.461798 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] network_auto_schedule          = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.461884 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] network_link_prefix            = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.461975 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.462074 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] notify_nova_on_port_data_changes = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.462168 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] notify_nova_on_port_status_changes = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.462243 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] pagination_max_limit           = -1 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.462318 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] periodic_fuzzy_delay           = 5 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.462318 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] periodic_interval              = 40 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.462491 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] publish_errors                 = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.462491 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_burst               = 0 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.462491 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_except_level        = CRITICAL {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.462723 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_interval            = 0 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.462723 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] retry_until_window             = 30 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.462723 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] router_distributed             = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.462938 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] rpc_resources_processing_step  = 20 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.462938 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] rpc_response_max_timeout       = 600 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.462938 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] rpc_response_timeout           = 60 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.463120 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] rpc_state_report_workers       = 0 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.463120 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] rpc_workers                    = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.463212 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] send_events_interval           = 2 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.463257 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] service_plugins                = ['ovn-router'] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.463370 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] setproctitle                   = on {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.463453 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] shell_completion               = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.463453 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] state_path                     = /opt/stack/data/neutron {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.463608 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] syslog_log_facility            = LOG_USER {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.463608 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] tcp_keepidle                   = 600 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.463772 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] transport_url                  = **** {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.463772 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] use_journal                    = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.463921 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] use_json                       = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.463921 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] use_ssl                        = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.463921 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] use_stderr                     = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.464178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] use_syslog                     = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.464178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] vlan_qinq                      = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.464178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] vlan_transparent               = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.464178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] wsgi_default_pool_size         = 100 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.464407 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] wsgi_keep_alive                = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.464407 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.464407 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] wsgi_server_debug              = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 07 19:34:55.464546 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_concurrency.disable_process_locking = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.464657 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.464799 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] profiler.connection_string     = messaging:// {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.464900 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] profiler.enabled               = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.464962 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_doc_type           = notification {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.465093 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_scroll_size        = 10000 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.465170 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_scroll_time        = 2m {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.465265 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] profiler.filter_error_trace    = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.465350 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] profiler.hmac_keys             = **** {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.465433 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] profiler.sentinel_service_name = mymaster {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.465526 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] profiler.socket_timeout        = 0.1 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.465588 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] profiler.trace_requests        = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.465668 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] profiler.trace_sqlalchemy      = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.465755 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] profiler_jaeger.process_tags   = {} {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.465839 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] profiler_jaeger.service_name_prefix = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.465839 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] profiler_otlp.service_name_prefix = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.465941 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.466054 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.466122 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_process_name =  {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.466226 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.466299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.466406 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.enforce_new_defaults = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.466472 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.enforce_scope      = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.466523 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_default_rule = default {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.466565 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.466606 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.466646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.466689 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.466736 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.466792 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.466839 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.466839 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_timeout     = 60.0 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.466929 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.466975 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] service_providers.service_provider = [] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.467296 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_section              = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.467296 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_type                 = password {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.467429 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_url                  = https://199.204.45.248/identity {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.467429 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.cafile                    = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.467429 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.certfile                  = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.467636 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.collect_timing            = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.467636 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.default_domain_id         = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.467636 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.default_domain_name       = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.467636 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.domain_id                 = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.467636 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.domain_name               = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468065 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.endpoint_type             = public {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468065 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.insecure                  = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468065 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.keyfile                   = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468065 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.password                  = **** {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468065 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.project_domain_id         = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468065 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.project_domain_name       = Default {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468065 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.project_id                = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468065 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.project_name              = service {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468065 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.region_name               = RegionOne {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468669 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.split_loggers             = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468669 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.system_scope              = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468669 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.timeout                   = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468669 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.trust_id                  = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468669 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.user_domain_id            = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468669 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.user_domain_name          = Default {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468669 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.user_id                   = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468669 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] nova.username                  = nova {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.468669 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] placement.auth_section         = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] placement.auth_type            = password {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] placement.cafile               = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] placement.certfile             = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] placement.collect_timing       = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] placement.endpoint_type        = public {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] placement.insecure             = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] placement.keyfile              = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] placement.region_name          = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] placement.split_loggers        = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469430 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] placement.timeout              = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469430 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.auth_section            = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469430 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.auth_type               = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469430 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.cafile                  = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469430 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.certfile                = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469430 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.collect_timing          = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469430 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.connect_retries         = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469430 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.connect_retry_delay     = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469430 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.enable_notifications    = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469772 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.endpoint_override       = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469772 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.insecure                = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469772 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.interface               = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469772 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.keyfile                 = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469772 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.max_version             = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469772 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.min_version             = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469772 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.region_name             = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469772 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.retriable_status_codes  = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.469772 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.service_name            = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.service_type            = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.split_loggers           = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.status_code_retries     = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.status_code_retry_delay = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.timeout                 = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.valid_interfaces        = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ironic.version                 = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] cli_script.dry_run             = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470523 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470523 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470523 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470523 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470523 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470523 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470523 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470814 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470814 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470814 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.hostname = np0000164077 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470814 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470814 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.470814 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.471277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.471277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.471277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.processname = neutron-ovn-maintenance-worker {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.471277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.471277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.471277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.471277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.471277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.471865 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.471865 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.471865 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.471865 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.471865 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.471865 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.471865 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.471865 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.472474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.472474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl      = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.472474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.472474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.472474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.472474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.472474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_version =  {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.472474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.472474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.driver = [] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.retry = -1 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.transport_url = **** {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.file_event_handler = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.log_dir           = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.default_quota           = -1 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_driver            = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_floatingip        = 50 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_network           = 100 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_port              = 500 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_router            = 10 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_security_group    = 10 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_security_group_rule = 100 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_subnet            = 100 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.473817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.track_quota_usage       = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.474507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.474507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep.group                  = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.474507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep.helper_command         = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.474507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep.log_daemon_traceback   = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.474507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep.logger_name            = oslo_privsep.daemon {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.474507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep.thread_pool_size       = 16 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.474507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep.user                   = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.474507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.474507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.group     = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.helper_command = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.log_daemon_traceback = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.thread_pool_size = 16 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.user      = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.group        = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.helper_command = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.logger_name  = oslo_privsep.daemon {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.thread_pool_size = 16 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.user         = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.capabilities = [21] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.group        = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.helper_command = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.log_daemon_traceback = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.logger_name  = oslo_privsep.daemon {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.475853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.thread_pool_size = 16 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.476537 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.user         = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.476537 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.capabilities = [12] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.476537 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.group        = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.476537 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.helper_command = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.476537 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.log_daemon_traceback = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.476537 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.logger_name  = oslo_privsep.daemon {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.476537 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.thread_pool_size = 16 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.476537 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.user         = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.476537 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.capabilities      = [12, 21] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.477249 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.group             = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.477249 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.helper_command    = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.477249 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.log_daemon_traceback = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.477249 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.logger_name       = oslo_privsep.daemon {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.477249 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.thread_pool_size  = 16 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.477249 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.user              = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.477249 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] AGENT.root_helper              = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.477249 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] AGENT.root_helper_daemon       = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.477853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] AGENT.use_helper_for_ns_read   = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.477853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.enable_ipset     = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.477853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.enable_security_group = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.477853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.firewall_driver  = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.477853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.477853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] experimental.ipv6_pd_enabled   = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.477853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ml2.extension_drivers          = ['port_security', 'qos'] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.477853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ml2.external_network_type      = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.477853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ml2.mechanism_drivers          = ['ovn'] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478571 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ml2.overlay_ip_version         = 4 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478571 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ml2.path_mtu                   = 0 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478571 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ml2.physical_network_mtus      = {} {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478571 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ml2.project_network_types      = ['geneve'] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478571 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ml2.tunnelled_network_rp_name  = rp_tunnelled {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478571 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'geneve'] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478571 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_flat.flat_networks    = ['public'] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478571 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_geneve.max_header_size = 38 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478571 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_geneve.vni_ranges     = ['1:65536'] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_vlan.network_vlan_ranges = ['public'] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] network_log.burst_limit        = 25 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] network_log.local_output_log_base = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] network_log.rate_limit         = 100 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.asyncio_connection    = **** {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.asyncio_slave_connection = **** {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.backend               = sqlalchemy {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.connection            = **** {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.478911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.connection_debug      = 0 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.479626 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.connection_parameters =  {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.479626 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.connection_recycle_time = 3600 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.479626 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.connection_trace      = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.479626 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.db_inc_retry_interval = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.479626 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.db_max_retries        = 20 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.479626 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.db_max_retry_interval = 10 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.479626 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.db_retry_interval     = 1 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.479626 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.max_overflow          = 50 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.479626 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.max_pool_size         = 5 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.480299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.max_retries           = 10 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.480299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.480299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.mysql_wsrep_sync_wait = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.480299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.pool_timeout          = None {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.480299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.retry_interval        = 10 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.480299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.slave_connection      = **** {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.480299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.sqlite_synchronous    = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.480299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.synchronous_reader    = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.480299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] database.use_db_reconnect      = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_min_rx                 = 1000 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_min_tx                 = 100 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_mult                   = 3 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.broadcast_arps_to_all_routers = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.dhcp_default_lease_time    = 43200 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.dns_records_ovn_owned      = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.dns_servers                = [] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.enable_distributed_floating_ip = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.fdb_age_threshold          = 300 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ha_failover_strategy       = normal {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.live_migration_activation_strategy = rarp {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.localnet_learn_fdb         = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.mac_binding_age_threshold  = 300 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.neutron_sync_mode          = log {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_dhcp4_global_options   = {} {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_dhcp6_global_options   = {} {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_l3_scheduler           = leastloaded {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481855 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_metadata_enabled       = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481855 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481855 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481855 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_connection          = ['ssl:199.204.45.248:6641'] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481855 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481855 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_router_indirect_snat   = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481855 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.481855 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_connection          = ['ssl:199.204.45.248:6642'] {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovs_create_tap             = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_connection_timeout   = 180 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_log_level            = INFO {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_probe_interval       = 60000 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_retry_max_interval   = 180 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.stateless_nat_enabled      = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn.vhost_sock_dir             = /var/run/openvswitch {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] OVS.bridge_mac_table_size      = 50000 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood                 = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood_reports         = True {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood_unregistered    = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_snooping_enable       = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] OVS.ovsdb_timeout              = 10 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.fdb_removal_limit = 0 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.ignore_lsp_down  = False {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 07 19:34:55.482855 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon.oslo_config_glue [-] ******************************************************************************** {{(pid=104575) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 07 19:34:55.482855 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG cotyledon._service_worker [-] Run service ServiceWrapper(0) [104575] {{(pid=104575) wait_forever /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/_service_worker.py:218}}
Apr 07 19:34:55.482855 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver.post_fork_initialize-886865', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._post_fork_initialize-582495'] for process (None), after_init {{(pid=104575) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Apr 07 19:34:55.483809 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbNbOvnIdl for MaintenanceWorker with retry
Apr 07 19:34:55.543707 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Logical_Switch.name {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 07 19:34:55.543932 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Logical_Router.name {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 07 19:34:55.543932 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Load_Balancer.name {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 07 19:34:55.543932 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Copp.name {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 07 19:34:55.543932 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Meter.name {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 07 19:34:55.544333 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Load_Balancer_Group.name {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 07 19:34:55.544333 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index HA_Chassis_Group.name {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 07 19:34:55.544333 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Address_Set.name {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 07 19:34:55.544333 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Connection.target {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 07 19:34:55.544333 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Gateway_Chassis.name {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 07 19:34:55.544333 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Mirror.name {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 07 19:34:55.544333 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Chassis_Template_Var.chassis {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 07 19:34:55.544717 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Logical_Router_Port.name {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 07 19:34:55.544717 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Port_Group.name {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 07 19:34:55.544717 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Logical_Switch_Port.name {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 07 19:34:55.550227 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.248:6641: connecting...
Apr 07 19:34:55.559217 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.248:6641: connected
Apr 07 19:34:55.595038 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbSbOvnIdl for MaintenanceWorker with retry
Apr 07 19:34:55.624190 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Chassis.name {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 07 19:34:55.624190 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Port_Binding.logical_port {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 07 19:34:55.624524 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Chassis_Private.name {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 07 19:34:55.624722 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Datapath_Binding.tunnel_key {{(pid=104575) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 07 19:34:55.627116 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.248:6642: connecting...
Apr 07 19:34:55.633170 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.248:6642: connected
Apr 07 19:34:55.667010 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_floatingip_request of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x7325bb2320c0>> floatingip precommit_update 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.667173 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_floatingip_request of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x7325bb2320c0>> floatingip precommit_delete 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.667173 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_port_has_port_forwarding of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x7325bb2320c0>> floatingip before_create 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.667335 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_port_has_port_forwarding of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x7325bb2320c0>> floatingip before_update 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.667335 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._process_port_request_handler of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x7325bb2320c0>> port after_update 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.667447 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._process_port_request_handler of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x7325bb2320c0>> port precommit_delete 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.667692 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding.register-7839544'] for port_forwarding_plugin (None), after_init {{(pid=104575) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Apr 07 19:34:55.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_notification of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x7325bcd6f800>> port_forwarding after_create 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.667866 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_lb_on_ls of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x7325bcd6f800>> router_interface after_create 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.668170 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_notification of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x7325bcd6f800>> port_forwarding after_update 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.668258 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_notification of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x7325bcd6f800>> port_forwarding after_delete 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.668334 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_lb_on_ls of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x7325bcd6f800>> router_interface after_delete 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.668465 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension
Apr 07 19:34:55.668542 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.placement [-] Starting OVNClientPlacementExtension
Apr 07 19:34:55.669003 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7325bbff0500>> segment before_delete 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.669086 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7325bbff0500>> subnet precommit_delete_associations 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.669403 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7325bb230b30>> segment_host_mapping after_create 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.669501 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_host_removal_from_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7325bb230b30>> segment_host_mapping after_delete 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.669501 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7325bb230b30>> port after_create 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.669675 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7325bb230b30>> port after_delete 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.669675 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7325bb230b30>> port after_update 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.669675 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7325bb230b30>> segment after_delete 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.669841 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7325bb230b30>> subnet after_create 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.669841 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7325bb230b30>> subnet after_delete 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.669968 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7325bb230b30>> subnet after_update 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.737178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7325bbe7f710>> subnet after_create 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.737178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7325bbe7f710>> subnet after_delete 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.737496 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7325bbe7f710>> subnet before_create 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.737496 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7325bbe7f710>> subnet before_update 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.740096 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method LoggingPlugin._clean_logs_by_resource_id of <neutron.services.logapi.logging_plugin.LoggingPlugin object at 0x7325bbfb8fb0>> security_group after_delete 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.740257 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method LoggingPlugin._clean_logs_by_target_id of <neutron.services.logapi.logging_plugin.LoggingPlugin object at 0x7325bbfb8fb0>> port after_delete 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.740257 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.services.logapi.drivers.ovn.driver.DriverBase._register-7652121'] for logging-plugin (None), after_init {{(pid=104575) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Apr 07 19:34:55.741277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupRuleCallBack.handle_event of <neutron.services.logapi.common.sg_callback.SecurityGroupRuleCallBack object at 0x7325bb257470>> security_group_rule after_create 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.741277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupRuleCallBack.handle_event of <neutron.services.logapi.common.sg_callback.SecurityGroupRuleCallBack object at 0x7325bb257470>> security_group_rule after_update 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:34:55.741277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupRuleCallBack.handle_event of <neutron.services.logapi.common.sg_callback.SecurityGroupRuleCallBack object at 0x7325bb257470>> security_group_rule after_delete 55550000, False {{(pid=104575) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 07 19:35:05.153571 np0000164077 neutron-ovn-maintenance-worker[103723]: DEBUG dbcounter [-] [103723] Writing DB stats neutron:SELECT=4 {{(pid=103723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:35:05.741474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [-] OVN-Northbound DB sync process started @ 2026-04-07 19:35:05.741128 {{(pid=104575) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:99}}
Apr 07 19:35:05.743426 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync port groups started @ 2026-04-07 19:35:05.743064 {{(pid=104575) sync_port_groups /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:132}}
Apr 07 19:35:05.760618 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writer thread running {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 07 19:35:05.772646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync port groups completed @ 2026-04-07 19:35:05.772311 {{(pid=104575) sync_port_groups /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:196}}
Apr 07 19:35:05.772824 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync networks, ports and DHCP options started @ 2026-04-07 19:35:05.772635 {{(pid=104575) sync_networks_ports_and_dhcp_opts /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1150}}
Apr 07 19:35:05.891259 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.services.segments.db [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7325bc07ea50>,) {'filters': {'network_id': ['bfbf6c8f-1f7e-474c-a618-4e99355c0282'], 'is_dynamic': False}} {{(pid=104575) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_log/helpers.py:77}}
Apr 07 19:35:05.896120 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync metadata ports started {{(pid=104575) _sync_metadata_ports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1095}}
Apr 07 19:35:06.134598 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync metadata ports completed {{(pid=104575) _sync_metadata_ports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1147}}
Apr 07 19:35:06.134598 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync DHCP options for Neutron subnets started {{(pid=104575) _sync_subnet_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:947}}
Apr 07 19:35:06.189140 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync DHCP options for Neutron subnets completed @ 2026-04-07 19:35:06.188812 {{(pid=104575) _sync_subnet_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1020}}
Apr 07 19:35:06.190221 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Apr 07 19:35:06.190523 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync DHCP options for Neutron ports with extra dhcp options assigned started {{(pid=104575) _sync_port_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1025}}
Apr 07 19:35:06.190673 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync DHCP options for Neutron ports with extra dhcp options assigned completed {{(pid=104575) _sync_port_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1084}}
Apr 07 19:35:06.190673 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync networks, ports and DHCP options completed @ 2026-04-07 19:35:06.190586 {{(pid=104575) sync_networks_ports_and_dhcp_opts /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1319}}
Apr 07 19:35:06.190891 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync ACLs started @ 2026-04-07 19:35:06.190686 {{(pid=104575) sync_acls /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:239}}
Apr 07 19:35:06.223712 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync ACLs completed @ 2026-04-07 19:35:06.223436 {{(pid=104575) sync_acls /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:429}}
Apr 07 19:35:06.223893 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync routers and router ports started @ 2026-04-07 19:35:06.223676 {{(pid=104575) sync_routers_and_rports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:734}}
Apr 07 19:35:06.270136 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Apr 07 19:35:06.270388 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync routers and router ports completed @ 2026-04-07 19:35:06.270043 {{(pid=104575) sync_routers_and_rports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:942}}
Apr 07 19:35:06.270388 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync port QoS policies started @ 2026-04-07 19:35:06.270298 {{(pid=104575) sync_port_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1367}}
Apr 07 19:35:06.270518 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] Starting OVNClientQosExtension
Apr 07 19:35:06.289856 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync port QoS policies completed @ 2026-04-07 19:35:06.289657 {{(pid=104575) sync_port_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1390}}
Apr 07 19:35:06.289972 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync Floating IP QoS policies started @ 2026-04-07 19:35:06.289853 {{(pid=104575) sync_fip_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1395}}
Apr 07 19:35:06.290078 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] Starting OVNClientQosExtension
Apr 07 19:35:06.310371 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync Floating IP QoS policies completed @ 2026-04-07 19:35:06.310168 {{(pid=104575) sync_fip_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1418}}
Apr 07 19:35:06.310520 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync Floating IP NAT rules started @ 2026-04-07 19:35:06.310349 {{(pid=104575) sync_fip_dnat_rules /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1423}}
Apr 07 19:35:06.310729 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-NB Sync Floating IP NAT rules completed @ 2026-04-07 19:35:06.310603 {{(pid=104575) sync_fip_dnat_rules /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1446}}
Apr 07 19:35:06.310836 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0826f454-e5d4-4ebb-b22c-6e2bf93eb50f None None] OVN-Northbound DB sync process completed @ 2026-04-07 19:35:06.310703 {{(pid=104575) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:112}}
Apr 07 19:35:15.742890 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [-] OVN-Southbound DB sync process started @ 2026-04-07 19:35:15.742375 {{(pid=104575) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1474}}
Apr 07 19:35:15.743726 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension
Apr 07 19:35:15.745469 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-a519a285-16b7-4360-9722-1191201a4f4f None None] OVN-SB Sync hostname and physical networks started @ 2026-04-07 19:35:15.745136 {{(pid=104575) sync_hostname_and_physical_networks /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1501}}
Apr 07 19:35:15.751763 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.752264 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_dhcp_options_consistency {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.752439 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_fair_meter_consistency {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.752874 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_fdb_aging_settings {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.753272 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_igmp_snoop_support {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.753272 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_inconsistencies {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.753592 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_global_dhcp_opts {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.753769 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.753939 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.754178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_provider_distributed_ports {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.754306 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.754459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.754626 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.cleanup_old_hash_ring_nodes {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.755544 np0000164077 neutron-ovn-maintenance-worker[104575]: WARNING neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-a519a285-16b7-4360-9722-1191201a4f4f None None] New host np0000164077 found in OVN SB DB, but not in Neutron. Add its SegmentHostMapping in Neutron
Apr 07 19:35:15.755705 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.configure_nb_global {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.755806 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_fip_distributed_flag {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.755867 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_network_type_and_physnet {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.755952 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_ovn_owned_dns_option {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.756044 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_ha_failover {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.757361 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.757361 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_mac_aging_settings {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.757591 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_router_distributed_flag {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.757591 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_router_static_routes {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.757591 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_security_group_with_address_group {{(pid=104575) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 07 19:35:15.760692 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:15.761521 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] Maintenance task thread has started
Apr 07 19:35:15.761617 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] MaintenanceWorker process has finished the post initialization
Apr 07 19:35:15.767312 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_dhcp_options_consistency' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:15.769789 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fair_meter_consistency' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:15.770908 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:15.772594 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fair_meter_consistency' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104575) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 07 19:35:15.775317 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_igmp_snoop_support' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:15.783567 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:15.787183 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_igmp_snoop_support' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104575) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 07 19:35:15.790468 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-04b43752-b41b-4ee9-baa9-043301fbdbd9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:15.792928 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_global_dhcp_opts' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:15.795107 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG oslo_concurrency.lockutils [None req-a519a285-16b7-4360-9722-1191201a4f4f None None] Acquiring lock "update_segment_host_mapping" by "neutron.services.segments.db.update_segment_host_mapping" {{(pid=104575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 07 19:35:15.795446 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG oslo_concurrency.lockutils [None req-a519a285-16b7-4360-9722-1191201a4f4f None None] Lock "update_segment_host_mapping" acquired by "neutron.services.segments.db.update_segment_host_mapping" :: waited 0.000s {{(pid=104575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 07 19:35:15.796637 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:15.797761 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_global_dhcp_opts' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104575) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 07 19:35:15.800963 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:15.808020 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_provider_distributed_ports' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:15.815344 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:15.822356 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Apr 07 19:35:15.833346 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:15.840436 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104575) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 07 19:35:15.853893 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.cleanup_old_hash_ring_nodes' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:15.886018 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:15.886622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:15.887423 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.configure_nb_global' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:15.892225 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:15.896713 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'ignore_lsp_down': 'false', 'fdb_removal_limit': '0', 'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:15.899834 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'ignore_lsp_down': 'false', 'fdb_removal_limit': '0', 'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:15.900437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:15.901788 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_network_type_and_physnet' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:15.907709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:15.907709 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:15.907709 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:15.907709 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:15.907709 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:15.907709 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:15.907709 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:15.907709 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:16.012919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.012919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:16.012919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:16.012919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:16.012919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.012919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:16.012919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:16.012919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:16.012919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.012919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:16.012919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:16.012919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:16.012919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:16.012919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:16.012919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:16.012919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:16.013897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:16.013897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:16.013897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:16.013897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:16.013897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:16.013897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:16.013897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.013897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:16.021390 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:35:16.022736 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_ovn_owned_dns_option' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:16.027754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:16.027754 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:16.027754 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:16.027754 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:16.027754 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:16.027754 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:16.027754 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.027754 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:16.032204 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron_lib.callbacks.manager [None req-a519a285-16b7-4360-9722-1191201a4f4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments-28945', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_host_addition_to_aggregate-8018943'] for segment_host_mapping (None), after_create {{(pid=104575) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Apr 07 19:35:16.104220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.configure_nb_global' (it runs every 86400.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.104220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:16.104220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:16.104220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:16.104220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:16.104220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:16.104220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.104220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:16.104220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:16.104220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.104220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:16.104220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:16.104220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.104220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 916, in configure_nb_global
Apr 07 19:35:16.104220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:35:16.104220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:16.104816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:16.105387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.105387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:16.105387 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Maintenance task: No inconsistencies found. Skipping {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:383}}
Apr 07 19:35:16.128340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.128340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:16.128340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:16.128340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:16.128340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:16.128340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:16.128340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.128340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:16.128340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:16.128340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.128340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:16.128340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:16.128340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.128340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:35:16.128340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:16.128340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.128340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.129344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:16.135573 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:16.142378 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.db.ovn_hash_ring_db [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Cleaned up Hash Ring nodes older than 5 days
Apr 07 19:35:16.147584 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:16.154591 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [None req-710502f2-943d-4610-9c91-9e31f0fca9df None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104575) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 07 19:35:16.156873 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.services.segments.db [None req-a519a285-16b7-4360-9722-1191201a4f4f None None] Segments {'783e27a6-53d0-42e0-a778-7125c7a0cff1'} mapped to the host np0000164077 {{(pid=104575) update_segment_host_mapping /opt/stack/neutron/neutron/services/segments/db.py:249}}
Apr 07 19:35:16.167331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.168086 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:16.178744 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:16.181453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:16.181453 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:16.181453 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:16.181453 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:16.181453 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:16.181453 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:16.181453 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.181453 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:16.205607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.205607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:16.205607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:16.205607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:16.205607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.205607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:16.205607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:16.205607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:16.205607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.205607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:16.205607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:16.205607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:16.205607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:16.205607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:16.205607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:16.205607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:16.206197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:16.206197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:16.206197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:16.206197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:16.206197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:16.206197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:16.206197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.206197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:16.211182 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_network_type_and_physnet' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104575) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 07 19:35:16.214414 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_dhcp_options_consistency' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104575) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 07 19:35:16.214768 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:16.215676 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Maintenance task: Check missing prefix router_name in external_ids of LRPs. {{(pid=104575) update_lrouter_ports_ext_ids_name_prefix /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:500}}
Apr 07 19:35:16.222350 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_ovn_owned_dns_option' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104575) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 07 19:35:16.222641 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG oslo_concurrency.lockutils [None req-a519a285-16b7-4360-9722-1191201a4f4f None None] Lock "update_segment_host_mapping" "released" by "neutron.services.segments.db.update_segment_host_mapping" :: held 0.388s {{(pid=104575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 07 19:35:16.222923 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-a519a285-16b7-4360-9722-1191201a4f4f None None] OVN-SB Sync hostname and physical networks completed @ 2026-04-07 19:35:16.222664 {{(pid=104575) sync_hostname_and_physical_networks /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1528}}
Apr 07 19:35:16.236331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.236331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:16.236331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:16.236331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:16.236331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:16.236331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:16.236331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.236331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:16.236331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:16.236331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.236331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:16.236331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:16.236331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.236331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:35:16.236331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:35:16.236331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:16.237114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:16.237796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:16.237796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.237796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:16.237796 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_distributed_flag' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:16.237796 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:16.242584 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:16.243685 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_static_routes' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:16.246582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.256750 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_security_group_with_address_group' {{(pid=104575) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 07 19:35:16.260260 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Maintenance task: Check missing prefix router_name in LRPs (took 0.04 seconds)
Apr 07 19:35:16.260474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104575) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 07 19:35:16.266351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:16.266351 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:16.266351 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:16.266351 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:16.266351 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:16.266351 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:16.266351 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.266351 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:16.276420 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [None req-a38d3f96-f4f6-4a36-a869-2336c0de2065 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_static_routes' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104575) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 07 19:35:16.299297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.299297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:16.299297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:16.299297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:16.299297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.299297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:16.299297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:16.299297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:16.299297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.299297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:16.299297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:16.299297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:16.299297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:16.299297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:16.299297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:16.299297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:16.299999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:16.299999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:16.299999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:16.299999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:16.299999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:16.299999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:16.299999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.299999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:16.319922 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_distributed_flag' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104575) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 07 19:35:16.340431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.340431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:16.340431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:16.340431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:16.340431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:16.340431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:16.340431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.340431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:16.340431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:16.340431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.340431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:16.340431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:16.340431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.340431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:35:16.340431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:35:16.340431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:16.341354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:16.342015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.342015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:16.342015 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:16.342015 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:16.342015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.344195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:16.344195 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:16.344195 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:16.344195 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:16.344195 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:16.344195 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:16.344195 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.344195 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:16.352467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.352467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:16.352467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:16.352467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:16.352467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:16.352467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:16.352467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.352467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:16.352467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:16.352467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.352467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:16.352467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:16.352467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.352467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:35:16.352467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:16.352467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.352467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.353483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:16.368446 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104575) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 07 19:35:16.391036 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_security_group_with_address_group' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104575) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 07 19:35:16.432499 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:16.432805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.438592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-04b43752-b41b-4ee9-baa9-043301fbdbd9 None None] Traceback (most recent call last):
Apr 07 19:35:16.438592 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:16.438592 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:16.438592 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:16.438592 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:16.438592 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:16.438592 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.438592 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:16.441259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-04b43752-b41b-4ee9-baa9-043301fbdbd9 None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.441259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:16.441259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:16.441259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:16.441259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:16.441259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:16.441259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.441259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:16.441259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:16.441259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.441259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:16.441259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:16.441259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:16.441259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:35:16.441259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:16.441259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.441259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:16.442295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:16.479949 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [None req-cd41fcbc-985b-462e-8179-9d5319736831 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_provider_distributed_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104575) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 07 19:35:16.751730 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104575) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 07 19:35:16.899120 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Apr 07 19:35:16.899567 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-a519a285-16b7-4360-9722-1191201a4f4f None None] OVN-Southbound DB sync process completed @ 2026-04-07 19:35:16.899179 {{(pid=104575) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1482}}
Apr 07 19:35:17.430118 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=918021f7-2559-4e15-9d57-45c4f0648849, enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1', 'neutron:subnet_ids': 'bdd6f685-b77d-459b-b386-e3ef09898997'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={'address_mode': 'slaac', 'mtu': '1372', 'send_periodic': 'true'}, mac='fa:16:3e:ee:b2:a8', name='lrp-ab1677cb-7800-419f-9e8f-81c1b2dfddce', networks=['fdb2:9789:1379::1/64'], options={}, peer=[], status={}) old= {{(pid=104575) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 07 19:35:17.431343 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension
Apr 07 19:35:17.480223 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282 synchronized; highest priority chassis a385a967-b7ed-41c2-87ea-de89001246d0
Apr 07 19:35:17.481237 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=HA_Chassis_Group, record=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, col_values=(('external_ids', {'neutron:availability_zone_hints': '', 'neutron:network_id': 'bfbf6c8f-1f7e-474c-a618-4e99355c0282', 'neutron:router_id': 'be0f7b17-b70a-49a9-a4ef-08f78a968ad1'}),), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:17.481691 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, chassis=a385a967-b7ed-41c2-87ea-de89001246d0, priority=1, columns={}) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:17.481999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:17.482844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:17.482844 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:17.482844 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:17.482844 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:17.482844 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:17.482844 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:17.482844 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:17.482844 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event Traceback (most recent call last):
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     match.run(event, row, updates)
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 86, in run
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.link_network_ha_chassis_group(
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2385, in link_network_ha_chassis_group
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     next(self.gen)
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     next(self.gen)
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     with self.create_transaction(
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     self.result = self.commit()
Apr 07 19:35:17.484598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Apr 07 19:35:17.485526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:17.485526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     raise result.ex
Apr 07 19:35:17.485526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:17.485526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Apr 07 19:35:17.485526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Apr 07 19:35:17.485526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:17.485526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Apr 07 19:35:17.485526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:17.485526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event 
Apr 07 19:35:20.203521 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=6e9edf3e-1944-4be1-b8e9-c8db821a946b, enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1', 'neutron:revision_number': '10', 'neutron:router_name': 'neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1', 'neutron:subnet_ids': '6de186a3-9e7c-4950-a1c6-817a37a68984 158905cc-b5be-42da-8777-3d7ded042b7c'}, gateway_chassis=[6c4b73a2-4ea9-4c04-8427-2864960e55c2], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:ad:20:66', name='lrp-141c27fb-22a2-4f5f-b8f3-31fa9c9e573c', networks=['172.24.5.147/24', '2001:db8::135/64'], options={'gateway_mtu': '1372', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=104575) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 07 19:35:20.205085 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=c15f20db-46f7-412e-be95-e68cbb233f0b, enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1', 'neutron:subnet_ids': '6de186a3-9e7c-4950-a1c6-817a37a68984'}, gateway_chassis=[6c4b73a2-4ea9-4c04-8427-2864960e55c2], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:ad:20:66', name='lrp-141c27fb-22a2-4f5f-b8f3-31fa9c9e573c', networks=['172.24.5.147/24'], options={'gateway_mtu': '1372', 'reside-on-redirect-chassis': 'true'}, peer=[], status={'hosting-chassis': 'a385a967-b7ed-41c2-87ea-de89001246d0'}) old= {{(pid=104575) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 07 19:35:20.249803 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282 synchronized; highest priority chassis a385a967-b7ed-41c2-87ea-de89001246d0
Apr 07 19:35:20.250821 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=HA_Chassis_Group, record=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, col_values=(('external_ids', {'neutron:availability_zone_hints': '', 'neutron:network_id': 'bfbf6c8f-1f7e-474c-a618-4e99355c0282', 'neutron:router_id': 'be0f7b17-b70a-49a9-a4ef-08f78a968ad1'}),), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:20.251347 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, chassis=a385a967-b7ed-41c2-87ea-de89001246d0, priority=1, columns={}) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:20.251744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.252646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:20.252646 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:20.252646 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:20.252646 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:20.252646 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:20.252646 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:20.252646 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.252646 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event Traceback (most recent call last):
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     match.run(event, row, updates)
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 89, in run
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.update_router_ha_chassis_group(
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1639, in update_router_ha_chassis_group
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     self.link_network_ha_chassis_group(context, network_id, router_id)
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2385, in link_network_ha_chassis_group
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     next(self.gen)
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     next(self.gen)
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:20.253813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     with self.create_transaction(
Apr 07 19:35:20.254860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:20.254860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     self.result = self.commit()
Apr 07 19:35:20.254860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Apr 07 19:35:20.254860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:20.254860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     raise result.ex
Apr 07 19:35:20.254860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:20.254860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Apr 07 19:35:20.254860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Apr 07 19:35:20.254860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:20.254860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Apr 07 19:35:20.254860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.254860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event 
Apr 07 19:35:20.287849 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282 synchronized; highest priority chassis a385a967-b7ed-41c2-87ea-de89001246d0
Apr 07 19:35:20.288690 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=HA_Chassis_Group, record=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, col_values=(('external_ids', {'neutron:availability_zone_hints': '', 'neutron:network_id': 'bfbf6c8f-1f7e-474c-a618-4e99355c0282', 'neutron:router_id': 'be0f7b17-b70a-49a9-a4ef-08f78a968ad1'}),), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:20.289165 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, chassis=a385a967-b7ed-41c2-87ea-de89001246d0, priority=1, columns={}) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:20.289409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.290299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:20.290299 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:20.290299 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:20.290299 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:20.290299 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:20.290299 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:20.290299 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.290299 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event Traceback (most recent call last):
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     match.run(event, row, updates)
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 81, in run
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.update_router_ha_chassis_group(
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1639, in update_router_ha_chassis_group
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     self.link_network_ha_chassis_group(context, network_id, router_id)
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2385, in link_network_ha_chassis_group
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     next(self.gen)
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     next(self.gen)
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:20.291715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     with self.create_transaction(
Apr 07 19:35:20.292622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:20.292622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     self.result = self.commit()
Apr 07 19:35:20.292622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Apr 07 19:35:20.292622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:20.292622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     raise result.ex
Apr 07 19:35:20.292622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:20.292622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Apr 07 19:35:20.292622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Apr 07 19:35:20.292622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:20.292622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Apr 07 19:35:20.292622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.292622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event 
Apr 07 19:35:20.777562 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:20.780060 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:20.819951 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:20.820226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.820815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Traceback (most recent call last):
Apr 07 19:35:20.820815 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:20.820815 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:20.820815 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:20.820815 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:20.820815 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:20.820815 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.820815 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:20.821707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.821707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:20.821707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:20.821707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:20.821707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:20.821707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:20.821707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:20.821707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:20.821707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:20.821707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:20.821707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:20.821707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:20.821707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:20.821707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:35:20.821707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:20.821707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:20.821707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.822571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:20.858678 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:20.860190 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:20.860450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.861047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:20.861047 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:20.861047 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:20.861047 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:20.861047 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:20.861047 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:20.861047 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.861047 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:20.862109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.862109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:20.862109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:20.862109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:20.862109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:20.862109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:20.862109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:20.862109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:20.862109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:20.862109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:20.862109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:20.862109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:20.862109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:20.862109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:35:20.862109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:20.862109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:20.862109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.862870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:20.913776 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:20.914699 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:35:20.915489 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:20.915922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.916953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Traceback (most recent call last):
Apr 07 19:35:20.916953 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:20.916953 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:20.916953 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:20.916953 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:20.916953 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:20.916953 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.916953 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:20.919593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.919593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:20.919593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:20.919593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:20.919593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:20.919593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:20.919593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:20.919593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:20.919593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:20.919593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:20.919593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:20.919593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:20.919593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:20.919593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:20.919593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:20.920342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:20.920342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:20.920342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:20.920342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:20.920342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:20.920342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:20.920342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:20.920342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.920342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:20.921494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.921494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:20.921494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:20.921494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:20.921494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:20.921494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:20.921494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:20.921494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:20.921494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:20.921494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:20.921494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:20.921494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:20.921494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:20.921494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:35:20.921494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:35:20.921494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:20.922209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:20.923053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:20.923053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:20.923053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:21.170828 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:21.171970 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:21.172784 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:21.173297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:21.174271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Traceback (most recent call last):
Apr 07 19:35:21.174271 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:21.174271 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:21.174271 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:21.174271 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:21.174271 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:21.174271 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:21.174271 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:21.175858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:21.175858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:21.175858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:21.175858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:21.175858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:21.175858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:21.175858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:21.175858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:21.175858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:21.175858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:21.175858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:21.175858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:21.175858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:21.175858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:21.175858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:21.176928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:21.176928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:21.176928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:21.176928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:21.176928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:21.176928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:21.176928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:21.176928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:21.176928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:21.178125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:21.178125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:21.178125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:21.178125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:21.178125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:21.178125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:21.178125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:21.178125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:21.178125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:21.178125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:21.178125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:21.178125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:21.178125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:21.178125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:35:21.178125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:35:21.178125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:21.178913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:21.179809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:21.179809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:21.221026 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:21.221669 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:21.222465 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:21.222966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:21.223256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:21.224165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Traceback (most recent call last):
Apr 07 19:35:21.224165 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:21.224165 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:21.224165 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:21.224165 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:21.224165 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:21.224165 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:21.224165 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:21.225304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:21.225304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:21.225304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:21.225304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:21.225304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:21.225304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:21.225304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:21.225304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:21.225304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:21.225304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:21.225304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:21.225304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:21.225304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:21.225304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:35:21.225304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:21.225304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:21.225304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:21.225810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:25.779319 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:25.781415 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:25.819762 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:25.820241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:25.821271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Traceback (most recent call last):
Apr 07 19:35:25.821271 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:25.821271 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:25.821271 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:25.821271 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:25.821271 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:25.821271 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:25.821271 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:25.822346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:25.822346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:25.822346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:25.822346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:25.822346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:25.822346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:25.822346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:25.822346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:25.822346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:25.822346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:25.822346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:25.822346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:25.822346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:25.822346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:35:25.822346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:25.822346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:25.822346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:25.823285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:25.859625 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:25.861688 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:25.862014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:25.862783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:25.862783 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:25.862783 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:25.862783 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:25.862783 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:25.862783 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:25.862783 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:25.862783 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:25.864596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:25.864596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:25.864596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:25.864596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:25.864596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:25.864596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:25.864596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:25.864596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:25.864596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:25.864596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:25.864596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:25.864596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:25.864596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:25.864596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:35:25.864596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:25.864596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:25.864596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:25.865496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:25.914859 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:25.916047 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:35:25.916912 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:25.917353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:25.918875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Traceback (most recent call last):
Apr 07 19:35:25.918875 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:25.918875 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:25.918875 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:25.918875 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:25.918875 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:25.918875 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:25.918875 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:25.920519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:25.920519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:25.920519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:25.920519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:25.920519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:25.920519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:25.920519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:25.920519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:25.920519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:25.920519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:25.920519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:25.920519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:25.920519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:25.920519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:25.920519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:25.921324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:25.921324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:25.921324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:25.921324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:25.921324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:25.921324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:25.921324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:25.921324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:25.921324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:25.922215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:25.922215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:25.922215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:25.922215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:25.922215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:25.922215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:25.922215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:25.922215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:25.922215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:25.922215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:25.922215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:25.922215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:25.922215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:25.922215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:35:25.922215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:35:25.922215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:25.923024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:25.923882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:25.923882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:25.923882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:26.171938 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:26.173382 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:26.174002 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:26.174570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:26.175829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Traceback (most recent call last):
Apr 07 19:35:26.175829 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:26.175829 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:26.175829 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:26.175829 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:26.175829 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:26.175829 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:26.175829 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:26.176537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:26.176537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:26.176537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:26.176537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:26.176537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:26.176537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:26.176537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:26.176537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:26.176537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:26.176537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:26.176537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:26.176537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:26.176537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:26.176537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:26.176537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:26.177171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:26.177171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:26.177171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:26.177171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:26.177171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:26.177171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:26.177171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:26.177171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:26.177171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:26.177542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:26.177542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:26.177542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:26.177542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:26.177542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:26.177542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:26.177542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:26.177542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:26.177542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:26.177542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:26.177542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:26.177542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:26.177542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:26.177542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:35:26.177542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:35:26.177542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:26.178194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:26.179173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:26.179173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:26.221768 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:26.223295 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:26.223907 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:26.224408 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:26.224709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:26.226133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Traceback (most recent call last):
Apr 07 19:35:26.226133 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:26.226133 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:26.226133 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:26.226133 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:26.226133 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:26.226133 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:26.226133 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:26.228347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:26.228347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:26.228347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:26.228347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:26.228347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:26.228347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:26.228347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:26.228347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:26.228347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:26.228347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:26.228347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:26.228347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:26.228347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:26.228347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:35:26.228347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:26.228347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:26.228347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:26.229251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:30.780817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:30.784784 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:30.818301 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:30.818785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:30.820922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:30.821366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:30.821791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:30.821791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:30.821791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:30.821791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:30.821791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:30.821791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:30.861222 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:30.862741 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:30.863006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:30.863722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:30.863722 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:30.863722 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:30.863722 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:30.863722 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:30.863722 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:30.863722 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:30.863722 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:30.865688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:30.865688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:30.865688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:30.865688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:30.865688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:30.865688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:30.865688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:30.865688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:30.865688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:30.865688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:30.865688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:30.865688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:30.865688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:30.865688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:35:30.865688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:30.865688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:30.865688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:30.866646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:30.915947 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:30.917098 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:35:30.917770 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:30.918142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:30.919084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:30.919084 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:30.919084 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:30.919084 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:30.919084 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:30.919084 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:30.919084 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:30.919084 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:30.920948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:30.920948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:30.920948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:30.920948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:30.920948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:30.920948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:30.920948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:30.920948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:30.920948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:30.920948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:30.920948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:30.920948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:30.920948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:30.920948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:30.920948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:30.920948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:30.921951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:30.921951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:30.921951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:30.921951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:30.921951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:30.921951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:30.921951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:30.921951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:30.923723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:30.923723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:30.923723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:30.923723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:30.923723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:30.923723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:30.923723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:30.923723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:30.923723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:30.923723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:30.923723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:30.923723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:30.923723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:30.923723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:35:30.923723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:35:30.923723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:30.924791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:30.925872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:30.925872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:30.925872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:31.173466 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:31.174436 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:31.175233 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:31.175755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:31.176748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Traceback (most recent call last):
Apr 07 19:35:31.176748 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:31.176748 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:31.176748 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:31.176748 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:31.176748 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:31.176748 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:31.176748 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:31.178021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:31.178021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:31.178021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:31.178021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:31.178021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:31.178021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:31.178021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:31.178021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:31.178021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:31.178021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:31.178021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:31.178021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:31.178021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:31.178021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:31.178021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:31.178938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:31.178938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:31.178938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:31.178938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:31.178938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:31.178938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:31.178938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:31.178938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:31.178938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:31.179589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:31.179589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:31.179589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:31.179589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:31.179589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:31.179589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:31.179589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:31.179589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:31.179589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:31.179589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:31.179589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:31.179589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:31.179589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:31.179589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:35:31.179589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:35:31.179589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:31.180366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:31.180911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:31.180911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:31.223391 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:31.224748 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:31.225510 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:31.225970 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:31.226230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:31.227612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Traceback (most recent call last):
Apr 07 19:35:31.227612 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:31.227612 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:31.227612 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:31.227612 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:31.227612 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:31.227612 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:31.227612 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:31.230056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:31.230056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:31.230056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:31.230056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:31.230056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:31.230056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:31.230056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:31.230056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:31.230056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:31.230056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:31.230056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:31.230056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:31.230056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:31.230056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:35:31.230056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:31.230056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:31.230056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:31.230906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:35.782442 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:35.787068 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:35.822458 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:35.822860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:35.823824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:35:35.823824 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:35.823824 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:35.823824 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:35.823824 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:35.823824 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:35.823824 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:35.823824 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:35.824850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:35.824850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:35.824850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:35.824850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:35.824850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:35.824850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:35.824850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:35.824850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:35.824850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:35.824850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:35.824850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:35.824850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:35.824850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:35.824850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:35:35.824850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:35.824850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:35.824850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:35.826330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:35.862352 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:35.864244 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:35.864451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:35.865053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:35.865053 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:35.865053 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:35.865053 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:35.865053 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:35.865053 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:35.865053 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:35.865053 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:35.866208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:35.866208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:35.866208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:35.866208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:35.866208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:35.866208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:35.866208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:35.866208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:35.866208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:35.866208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:35.866208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:35.866208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:35.866208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:35.866208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:35:35.866208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:35.866208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:35.866208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:35.866718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:35.917383 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:35.918841 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:35:35.919539 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:35.919795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:35.920512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:35.920512 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:35.920512 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:35.920512 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:35.920512 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:35.920512 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:35.920512 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:35.920512 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:35.921674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:35.921674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:35.921674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:35.921674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:35.921674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:35.921674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:35.921674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:35.921674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:35.921674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:35.921674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:35.921674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:35.921674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:35.921674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:35.921674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:35.921674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:35.921674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:35.922471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:35.922471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:35.922471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:35.922471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:35.922471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:35.922471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:35.922471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:35.922471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:35.922834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:35.922834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:35.922834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:35.922834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:35.922834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:35.922834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:35.922834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:35.922834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:35.922834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:35.922834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:35.922834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:35.922834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:35.922834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:35.922834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:35:35.922834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:35:35.922834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:35.923598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:35.924464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:35.924464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:35.924464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:36.174516 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:36.175882 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:36.176744 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:36.177244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:36.178229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Traceback (most recent call last):
Apr 07 19:35:36.178229 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:36.178229 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:36.178229 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:36.178229 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:36.178229 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:36.178229 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:36.178229 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:36.179642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:36.179642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:36.179642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:36.179642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:36.179642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:36.179642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:36.179642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:36.179642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:36.179642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:36.179642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:36.179642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:36.179642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:36.179642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:36.179642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:36.179642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:36.179943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:36.179943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:36.179943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:36.179943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:36.179943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:36.179943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:36.179943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:36.179943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:36.179943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:36.181477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:36.181477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:36.181477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:36.181477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:36.181477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:36.181477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:36.181477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:36.181477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:36.181477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:36.181477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:36.181477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:36.181477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:36.181477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:36.181477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:35:36.181477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:35:36.181477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:36.181854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:36.182427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:36.182427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:36.224832 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:36.226012 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:36.226623 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:36.227046 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:36.227238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:36.228076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Traceback (most recent call last):
Apr 07 19:35:36.228076 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:36.228076 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:36.228076 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:36.228076 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:36.228076 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:36.228076 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:36.228076 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:36.229298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:36.229298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:36.229298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:36.229298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:36.229298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:36.229298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:36.229298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:36.229298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:36.229298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:36.229298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:36.229298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:36.229298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:36.229298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:36.229298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:35:36.229298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:36.229298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:36.229298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:36.229682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:40.785639 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:40.788602 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:40.820435 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:40.820598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:40.821067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:35:40.821067 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:40.821067 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:40.821067 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:40.821067 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:40.821067 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:40.821067 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:40.821067 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:40.821892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:40.821892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:40.821892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:40.821892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:40.821892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:40.821892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:40.821892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:40.821892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:40.821892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:40.821892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:40.821892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:40.821892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:40.821892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:40.821892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:35:40.821892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:40.821892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:40.821892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:40.822738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:40.863545 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:40.865267 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:40.865635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:40.866486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:40.866486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:40.866486 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:40.866486 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:40.866486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:40.866486 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:40.866486 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:40.866486 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:40.868282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:40.868282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:40.868282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:40.868282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:40.868282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:40.868282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:40.868282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:40.868282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:40.868282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:40.868282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:40.868282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:40.868282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:40.868282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:40.868282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:35:40.868282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:40.868282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:40.868282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:40.869158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:40.918797 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:40.919652 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:35:40.920501 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:40.920859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:40.921705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:40.921705 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:40.921705 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:40.921705 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:40.921705 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:40.921705 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:40.921705 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:40.921705 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:40.922620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:40.922620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:40.922620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:40.922620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:40.922620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:40.922620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:40.922620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:40.922620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:40.922620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:40.922620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:40.922620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:40.922620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:40.922620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:40.922620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:40.922620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:40.922620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:40.923375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:40.923375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:40.923375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:40.923375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:40.923375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:40.923375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:40.923375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:40.923375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:40.923750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:40.923750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:40.923750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:40.923750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:40.923750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:40.923750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:40.923750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:40.923750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:40.923750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:40.923750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:40.923750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:40.923750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:40.923750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:40.923750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:35:40.923750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:35:40.923750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:40.924500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:40.925356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:40.925356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:40.925356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:41.175953 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:41.177178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:41.177858 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:41.178399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:41.180364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Traceback (most recent call last):
Apr 07 19:35:41.180364 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:41.180364 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:41.180364 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:41.180364 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:41.180364 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:41.180364 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:41.180364 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:41.181656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:41.181656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:41.181656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:41.181656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:41.181656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:41.181656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:41.181656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:41.181656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:41.181656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:41.181656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:41.181656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:41.181656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:41.181656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:41.181656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:41.181656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:41.182325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:41.182325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:41.182325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:41.182325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:41.182325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:41.182325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:41.182325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:41.182325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:41.182325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:41.183645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-cdc1a838-e811-4bee-8056-2b776efda11a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:41.183645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:41.183645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:41.183645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:41.183645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:41.183645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:41.183645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:41.183645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:41.183645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:41.183645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:41.183645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:41.183645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:41.183645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:41.183645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:35:41.183645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:35:41.183645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:41.185326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:41.186754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:41.186754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:41.226125 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:41.227396 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:41.227903 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:41.228358 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:41.228588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:41.229591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Traceback (most recent call last):
Apr 07 19:35:41.229591 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:41.229591 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:41.229591 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:41.229591 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:41.229591 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:41.229591 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:41.229591 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:41.230697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:41.230697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:41.230697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:41.230697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:41.230697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:41.230697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:41.230697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:41.230697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:41.230697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:41.230697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:41.230697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:41.230697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:41.230697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:41.230697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:35:41.230697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:41.230697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:41.230697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:41.231571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:45.788158 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:45.790238 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:45.827510 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:45.827766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:45.828619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:35:45.828619 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:45.828619 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:45.828619 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:45.828619 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:45.828619 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:45.828619 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:45.828619 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:45.829980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:45.829980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:45.829980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:45.829980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:45.829980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:45.829980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:45.829980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:45.829980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:45.829980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:45.829980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:45.829980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:45.829980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:45.829980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:45.829980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:35:45.829980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:45.829980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:45.829980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:45.830822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:45.864759 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:45.866435 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:45.866725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:45.867602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:45.867602 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:45.867602 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:45.867602 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:45.867602 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:45.867602 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:45.867602 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:45.867602 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:45.868971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:45.868971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:45.868971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:45.868971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:45.868971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:45.868971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:45.868971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:45.868971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:45.868971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:45.868971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:45.868971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:45.868971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:45.868971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:45.868971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:35:45.868971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:45.868971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:45.868971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:45.869815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:45.919922 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:45.920937 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:35:45.921577 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:45.921963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:45.922783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:45.922783 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:45.922783 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:45.922783 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:45.922783 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:45.922783 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:45.922783 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:45.922783 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:45.924065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:45.924065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:45.924065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:45.924065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:45.924065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:45.924065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:45.924065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:45.924065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:45.924065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:45.924065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:45.924065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:45.924065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:45.924065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:45.924065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:45.924065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:45.924065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:45.924815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:45.924815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:45.924815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:45.924815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:45.924815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:45.924815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:45.924815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:45.924815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:45.925302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:45.925302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:45.925302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:45.925302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:45.925302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:45.925302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:45.925302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:45.925302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:45.925302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:45.925302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:45.925302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:45.925302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:45.925302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:45.925302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:35:45.925302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:35:45.925302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:45.926165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:45.927392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:45.927392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:45.927392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:46.177312 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:46.178161 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:46.179075 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:46.179488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:46.180413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:46.180413 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:46.180413 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:46.180413 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:46.180413 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:46.180413 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:46.180413 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:46.180413 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:46.181349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:46.181349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:46.181349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:46.181349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:46.181349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:46.181349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:46.181349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:46.181349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:46.181349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:46.181349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:46.181349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:46.181349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:46.181349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:46.181349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:46.181349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:46.181349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:46.182100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:46.182100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:46.182100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:46.182100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:46.182100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:46.182100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:46.182100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:46.182100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:46.182443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:46.182443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:46.182443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:46.182443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:46.182443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:46.182443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:46.182443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:46.182443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:46.182443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:46.182443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:46.182443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:46.182443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:46.182443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:46.182443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:35:46.182443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:35:46.182443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:46.183101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:46.183854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:46.183854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:46.227428 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:46.228660 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:46.229454 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:46.229895 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:46.230162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:46.231115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Traceback (most recent call last):
Apr 07 19:35:46.231115 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:46.231115 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:46.231115 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:46.231115 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:46.231115 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:46.231115 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:46.231115 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:46.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:46.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:46.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:46.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:46.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:46.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:46.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:46.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:46.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:46.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:46.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:46.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:46.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:46.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:35:46.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:46.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:46.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:46.233688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:50.789274 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:50.792103 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:50.823495 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:50.823816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:50.824847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:35:50.824847 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:50.824847 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:50.824847 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:50.824847 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:50.824847 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:50.824847 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:50.824847 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:50.826344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:50.826344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:50.826344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:50.826344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:50.826344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:50.826344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:50.826344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:50.826344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:50.826344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:50.826344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:50.826344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:50.826344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:50.826344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:50.826344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:35:50.826344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:50.826344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:50.826344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:50.827455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:50.865761 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:50.870433 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:50.870893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:50.871635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:50.871635 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:50.871635 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:50.871635 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:50.871635 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:50.871635 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:50.871635 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:50.871635 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:50.872878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:50.872878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:50.872878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:50.872878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:50.872878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:50.872878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:50.872878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:50.872878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:50.872878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:50.872878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:50.872878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:50.872878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:50.872878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:50.872878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:35:50.872878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:50.872878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:50.872878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:50.873872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:50.921041 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:50.922043 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:35:50.922872 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:50.923241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:50.926551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:50.927311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:50.927311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:50.927311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:50.927311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:50.927311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:50.927311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:50.927311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:50.927311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:50.927311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:50.927311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:50.927311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:50.927311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:50.927311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:50.927311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:50.927311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:50.927807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:50.928632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:50.928632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:50.928632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:50.928632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:50.928632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:50.928632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:50.928632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:50.928632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:50.928632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:50.928632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:50.928632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:50.928632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:50.928632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:50.928632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:50.928632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:50.928632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:50.928632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:51.178291 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:51.179611 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:51.180300 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:51.180626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:51.182106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:51.182106 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:51.182106 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:51.182106 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:51.182106 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:51.182106 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:51.182106 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:51.182106 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:51.183512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:51.183512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:51.183512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:51.183512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:51.183512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:51.183512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:51.183512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:51.183512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:51.183512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:51.183512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:51.183512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:51.183512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:51.183512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:51.183512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:51.183512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:51.183512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:51.184557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:51.184557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:51.184557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:51.184557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:51.184557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:51.184557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:51.184557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:51.184557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:51.186453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:51.186453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:51.186453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:51.186453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:51.186453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:51.186453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:51.186453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:51.186453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:51.186453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:51.186453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:51.186453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:51.186453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:51.186453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:51.186453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:35:51.186453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:35:51.186453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:51.187568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:51.188720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:51.188720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:51.230774 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:51.231777 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:51.232518 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:51.232838 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:51.232979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:51.233710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Traceback (most recent call last):
Apr 07 19:35:51.233710 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:51.233710 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:51.233710 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:51.233710 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:51.233710 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:51.233710 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:51.233710 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:51.236496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-9e7acf41-fb1e-436b-92f1-b0a0f4757d65 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:51.236496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:51.236496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:51.236496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:51.236496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:51.236496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:51.236496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:51.236496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:51.236496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:51.236496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:51.236496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:51.236496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:51.236496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:51.236496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:35:51.236496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:51.236496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:51.236496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:51.236959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:55.790916 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:55.794084 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-92cafed4-ba6e-43f0-a08f-796ccf42fcee None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:55.827499 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:55.827683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:55.828245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-92cafed4-ba6e-43f0-a08f-796ccf42fcee None None] Traceback (most recent call last):
Apr 07 19:35:55.828245 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:55.828245 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:55.828245 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:55.828245 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:55.828245 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:55.828245 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:55.828245 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:55.829072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-92cafed4-ba6e-43f0-a08f-796ccf42fcee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:55.829072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:55.829072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:55.829072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:55.829072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:55.829072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:55.829072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:55.829072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:55.829072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:55.829072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:55.829072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:55.829072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:55.829072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:55.829072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:35:55.829072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:55.829072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:55.829072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:55.829625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:55.869817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:55.871622 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:55.871892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:55.872625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:55.872625 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:55.872625 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:55.872625 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:55.872625 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:55.872625 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:55.872625 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:55.872625 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:55.874261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:55.874261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:55.874261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:55.874261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:55.874261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:55.874261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:55.874261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:55.874261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:55.874261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:55.874261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:55.874261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:55.874261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:55.874261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:55.874261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:35:55.874261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:55.874261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:55.874261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:55.874746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:55.922067 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:55.923833 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:35:55.924477 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:55.925167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:55.927382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:55.928369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:55.928369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:55.928369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:55.928369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:55.928369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:55.928369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:55.928369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:55.928369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:55.928369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:55.928369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:55.928369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:55.928369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:55.928369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:55.930694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:55.930694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:55.930694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:55.930694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:55.930694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:55.930694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:55.930694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:55.930694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:55.930694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:55.930694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:55.930694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:55.930694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:55.930694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:55.930694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:35:55.930694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:35:55.930694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:55.931496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:55.932520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:55.932520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:55.932520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:56.179425 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:56.180207 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:56.180854 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:56.181179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:56.181750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:56.181750 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:56.181750 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:56.181750 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:56.181750 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:56.181750 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:56.181750 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:56.181750 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:56.182428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:56.182428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:35:56.182428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:56.182428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:56.182428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:56.182428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:56.182428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:56.182428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:56.182428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:56.182428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:35:56.182428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:56.182428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:35:56.182428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:56.182428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:35:56.182428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:35:56.182428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:56.182831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:35:56.182831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:56.182831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:35:56.182831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:35:56.182831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:56.182831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:35:56.182831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:56.182831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:35:56.183236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:56.183236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:56.183236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:56.183236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:56.183236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:56.183236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:56.183236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:56.183236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:56.183236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:56.183236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:56.183236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:56.183236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:56.183236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:56.183236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:35:56.183236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:35:56.183236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:56.183552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:56.183905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:56.183905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:35:56.231772 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:35:56.232569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:35:56.233239 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:56.233685 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:35:56.233882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:56.234704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:35:56.234704 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:56.234704 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:35:56.234704 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:35:56.234704 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:56.234704 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:35:56.234704 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:56.234704 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:35:56.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:56.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:35:56.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:35:56.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:35:56.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:35:56.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:35:56.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:56.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:35:56.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:35:56.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:35:56.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:35:56.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:35:56.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:35:56.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:35:56.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:35:56.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:56.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:35:56.236417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:00.793020 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:00.795149 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:00.827270 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:00.827730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:00.828679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Traceback (most recent call last):
Apr 07 19:36:00.828679 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:00.828679 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:00.828679 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:00.828679 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:00.828679 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:00.828679 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:00.828679 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:00.830070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:00.830070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:00.830070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:00.830070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:00.830070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:00.830070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:00.830070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:00.830070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:00.830070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:00.830070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:00.830070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:00.830070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:00.830070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:00.830070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:36:00.830070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:00.830070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:00.830070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:00.830937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:00.871129 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:00.874668 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:00.875081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:00.876033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:00.876033 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:00.876033 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:00.876033 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:00.876033 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:00.876033 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:00.876033 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:00.876033 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:00.878014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:00.878014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:00.878014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:00.878014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:00.878014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:00.878014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:00.878014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:00.878014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:00.878014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:00.878014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:00.878014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:00.878014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:00.878014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:00.878014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:36:00.878014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:00.878014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:00.878014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:00.878783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:00.923873 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:00.925090 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:36:00.925934 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:00.926354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:00.927195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:00.927195 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:00.927195 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:00.927195 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:00.927195 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:00.927195 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:00.927195 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:00.927195 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:00.928602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:00.928602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:00.928602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:00.928602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:00.928602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:00.928602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:00.928602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:00.928602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:00.928602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:00.928602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:00.928602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:00.928602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:00.928602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:00.928602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:00.928602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:00.928602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:00.929443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:00.929443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:00.929443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:00.929443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:00.929443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:00.929443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:00.929443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:00.929443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:00.930445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:00.930445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:00.930445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:00.930445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:00.930445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:00.930445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:00.930445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:00.930445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:00.930445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:00.930445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:00.930445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:00.930445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:00.930445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:00.930445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:36:00.930445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:36:00.930445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:00.931217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:00.932078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:00.932078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:00.932078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:01.180497 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:01.181895 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:01.182566 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:01.182836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:01.183309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:01.183309 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:01.183309 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:01.183309 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:01.183309 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:01.183309 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:01.183309 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:01.183309 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:01.183841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:01.183841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:01.183841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:01.183841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:01.183841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:01.183841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:01.183841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:01.183841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:01.183841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:01.183841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:01.183841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:01.183841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:01.183841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:01.183841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:01.183841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:01.183841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:01.184330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:01.184330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:01.184330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:01.184330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:01.184330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:01.184330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:01.184330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:01.184330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:01.184579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:01.184579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:01.184579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:01.184579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:01.184579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:01.184579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:01.184579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:01.184579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:01.184579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:01.184579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:01.184579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:01.184579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:01.184579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:01.184579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:36:01.184579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:36:01.184579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:01.185000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:01.185485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:01.185485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:01.232704 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:01.234313 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:01.234844 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:01.235095 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:01.235176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:01.236943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:01.237519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:01.238045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:01.238045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:01.238045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:01.238045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:05.794613 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:05.797087 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:05.798747 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=577,neutron:INSERT=1,neutron:UPDATE=2,neutron:DELETE=1 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:36:05.834743 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:05.835319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:05.836374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:36:05.836374 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:05.836374 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:05.836374 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:05.836374 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:05.836374 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:05.836374 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:05.836374 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:05.837279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:05.837279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:05.837279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:05.837279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:05.837279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:05.837279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:05.837279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:05.837279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:05.837279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:05.837279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:05.837279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:05.837279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:05.837279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:05.837279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:36:05.837279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:05.837279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:05.837279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:05.838252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:05.873171 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:05.875549 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:05.875869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:05.876708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:05.876708 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:05.876708 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:05.876708 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:05.876708 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:05.876708 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:05.876708 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:05.876708 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:05.878802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:05.878802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:05.878802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:05.878802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:05.878802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:05.878802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:05.878802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:05.878802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:05.878802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:05.878802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:05.878802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:05.878802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:05.878802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:05.878802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:36:05.878802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:05.878802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:05.878802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:05.880079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:05.925346 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:05.926841 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:36:05.927229 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:05.927524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:05.928629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:05.928629 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:05.928629 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:05.928629 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:05.928629 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:05.928629 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:05.928629 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:05.928629 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:05.929562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:05.929562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:05.929562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:05.929562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:05.929562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:05.929562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:05.929562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:05.929562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:05.929562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:05.929562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:05.929562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:05.929562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:05.929562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:05.929562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:05.929562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:05.929562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:05.930162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:05.930162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:05.930162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:05.930162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:05.930162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:05.930162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:05.930162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:05.930162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:05.931602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:05.931602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:05.931602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:05.931602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:05.931602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:05.931602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:05.931602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:05.931602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:05.931602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:05.931602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:05.931602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:05.931602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:05.931602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:05.931602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:36:05.931602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:36:05.931602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:05.932152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:05.933276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:05.933276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:05.933276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:06.182371 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:06.183681 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:06.184283 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:06.185117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:06.185683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:06.185683 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:06.185683 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:06.185683 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:06.185683 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:06.185683 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:06.185683 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:06.185683 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:06.187050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:06.187050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:06.187050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:06.187050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:06.187050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:06.187050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:06.187050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:06.187050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:06.187050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:06.187050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:06.187050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:06.187050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:06.187050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:06.187050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:06.187050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:06.187050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:06.187788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:06.187788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:06.187788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:06.187788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:06.187788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:06.187788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:06.187788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:06.187788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:06.189026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:06.189026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:06.189026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:06.189026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:06.189026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:06.189026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:06.189026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:06.189026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:06.189026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:06.189026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:06.189026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:06.189026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:06.189026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:06.189026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:36:06.189026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:36:06.189026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:06.189781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:06.190658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:06.190658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:06.234506 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:06.236001 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:06.236628 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:06.237086 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:06.237291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:06.238280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:06.238280 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:06.238280 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:06.238280 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:06.238280 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:06.238280 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:06.238280 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:06.238280 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:06.240471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:06.240471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:06.240471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:06.240471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:06.240471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:06.240471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:06.240471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:06.240471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:06.240471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:06.240471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:06.240471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:06.240471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:06.240471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:06.240471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:36:06.240471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:06.240471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:06.240471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:06.241569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:10.796096 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:10.798627 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:10.834341 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:10.834941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:10.836147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:36:10.836147 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:10.836147 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:10.836147 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:10.836147 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:10.836147 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:10.836147 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:10.836147 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:10.837532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:10.837532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:10.837532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:10.837532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:10.837532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:10.837532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:10.837532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:10.837532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:10.837532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:10.837532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:10.837532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:10.837532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:10.837532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:10.837532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:36:10.837532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:10.837532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:10.837532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:10.838446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:10.875078 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:10.876798 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:10.877149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:10.878090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:10.878090 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:10.878090 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:10.878090 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:10.878090 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:10.878090 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:10.878090 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:10.878090 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:10.880024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:10.880024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:10.880024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:10.880024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:10.880024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:10.880024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:10.880024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:10.880024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:10.880024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:10.880024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:10.880024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:10.880024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:10.880024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:10.880024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:36:10.880024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:10.880024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:10.880024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:10.881040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:10.926798 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:10.927934 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:36:10.928618 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:10.929057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:10.930020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:10.930020 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:10.930020 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:10.930020 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:10.930020 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:10.930020 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:10.930020 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:10.930020 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:10.931608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:10.931608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:10.931608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:10.931608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:10.931608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:10.931608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:10.931608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:10.931608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:10.931608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:10.931608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:10.931608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:10.931608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:10.931608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:10.931608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:10.931608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:10.931608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:10.932640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:10.932640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:10.932640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:10.932640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:10.932640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:10.932640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:10.932640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:10.932640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:10.934211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:10.934211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:10.934211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:10.934211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:10.934211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:10.934211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:10.934211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:10.934211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:10.934211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:10.934211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:10.934211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:10.934211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:10.934211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:10.934211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:36:10.934211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:36:10.934211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:10.934724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:10.935336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:10.935336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:10.935336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:11.184040 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:11.185147 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:11.185795 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:11.186295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:11.187195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:11.187195 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:11.187195 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:11.187195 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:11.187195 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:11.187195 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:11.187195 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:11.187195 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:11.188524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:11.188524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:11.188524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:11.188524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:11.188524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:11.188524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:11.188524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:11.188524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:11.188524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:11.188524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:11.188524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:11.188524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:11.188524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:11.188524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:11.188524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:11.188524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:11.189300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:11.189300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:11.189300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:11.189300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:11.189300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:11.189300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:11.189300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:11.189300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:11.190166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:11.190166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:11.190166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:11.190166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:11.190166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:11.190166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:11.190166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:11.190166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:11.190166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:11.190166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:11.190166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:11.190166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:11.190166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:11.190166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:36:11.190166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:36:11.190166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:11.190915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:11.191861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:11.191861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:11.235816 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:11.237062 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:11.237948 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:11.238514 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:11.238711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:11.239602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:11.239602 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:11.239602 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:11.239602 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:11.239602 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:11.239602 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:11.239602 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:11.239602 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:11.241473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:11.241473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:11.241473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:11.241473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:11.241473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:11.241473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:11.241473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:11.241473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:11.241473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:11.241473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:11.241473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:11.241473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:11.241473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:11.241473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:36:11.241473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:11.241473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:11.241473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:11.242642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:15.797433 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:15.799622 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:15.833102 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:15.833583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:15.834760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Traceback (most recent call last):
Apr 07 19:36:15.834760 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:15.834760 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:15.834760 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:15.834760 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:15.834760 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:15.834760 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:15.834760 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:15.836249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:15.836249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:15.836249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:15.836249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:15.836249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:15.836249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:15.836249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:15.836249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:15.836249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:15.836249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:15.836249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:15.836249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:15.836249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:15.836249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:36:15.836249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:15.836249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:15.836249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:15.837024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:15.876213 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:15.877748 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:15.878147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:15.879024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:15.879024 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:15.879024 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:15.879024 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:15.879024 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:15.879024 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:15.879024 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:15.879024 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:15.880802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:15.880802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:15.880802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:15.880802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:15.880802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:15.880802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:15.880802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:15.880802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:15.880802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:15.880802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:15.880802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:15.880802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:15.880802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:15.880802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:36:15.880802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:15.880802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:15.880802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:15.881731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:15.928026 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:15.928633 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:36:15.929381 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:15.929593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:15.930250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:15.930250 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:15.930250 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:15.930250 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:15.930250 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:15.930250 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:15.930250 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:15.930250 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:15.931645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:15.931645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:15.931645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:15.931645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:15.931645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:15.931645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:15.931645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:15.931645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:15.931645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:15.931645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:15.931645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:15.931645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:15.931645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:15.931645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:15.931645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:15.931645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:15.932037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:15.932037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:15.932037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:15.932037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:15.932037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:15.932037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:15.932037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:15.932037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:15.933148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:15.933148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:15.933148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:15.933148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:15.933148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:15.933148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:15.933148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:15.933148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:15.933148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:15.933148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:15.933148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:15.933148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:15.933148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:15.933148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:36:15.933148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:36:15.933148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:15.933626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:15.933975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:15.933975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:15.933975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:16.185392 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:16.186248 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:16.186741 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:16.187011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:16.188126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:16.188126 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:16.188126 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:16.188126 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:16.188126 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:16.188126 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:16.188126 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:16.188126 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:16.189203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:16.189203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:16.189203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:16.189203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:16.189203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:16.189203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:16.189203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:16.189203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:16.189203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:16.189203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:16.189203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:16.189203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:16.189203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:16.189203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:16.189203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:16.189203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:16.190038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:16.190038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:16.190038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:16.190038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:16.190038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:16.190038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:16.190038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:16.190038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:16.190852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:16.190852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:16.190852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:16.190852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:16.190852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:16.190852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:16.190852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:16.190852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:16.190852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:16.190852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:16.190852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:16.190852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:16.190852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:16.190852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:36:16.190852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:36:16.190852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:16.191652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:16.192526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:16.192526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:16.236946 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:16.237701 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:16.238469 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:16.238879 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:16.239104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:16.239918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:16.239918 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:16.239918 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:16.239918 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:16.239918 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:16.239918 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:16.239918 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:16.239918 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:16.241737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:16.241737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:16.241737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:16.241737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:16.241737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:16.241737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:16.241737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:16.241737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:16.241737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:16.241737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:16.241737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:16.241737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:16.241737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:16.241737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:36:16.241737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:16.241737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:16.241737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:16.242540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:20.799144 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:20.801218 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:20.830828 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:20.830828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:20.831482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:36:20.831482 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:20.831482 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:20.831482 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:20.831482 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:20.831482 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:20.831482 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:20.831482 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:20.832213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:20.832213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:20.832213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:20.832213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:20.832213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:20.832213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:20.832213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:20.832213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:20.832213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:20.832213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:20.832213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:20.832213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:20.832213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:20.832213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:36:20.832213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:20.832213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:20.832213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:20.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:20.877462 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:20.878711 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:20.878977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:20.880097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:20.880097 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:20.880097 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:20.880097 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:20.880097 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:20.880097 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:20.880097 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:20.880097 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:20.882666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:20.882666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:20.882666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:20.882666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:20.882666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:20.882666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:20.882666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:20.882666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:20.882666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:20.882666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:20.882666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:20.882666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:20.882666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:20.882666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:36:20.882666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:20.882666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:20.882666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:20.883899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:20.928790 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:20.929361 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:36:20.930010 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:20.930357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:20.931230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:20.931230 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:20.931230 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:20.931230 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:20.931230 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:20.931230 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:20.931230 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:20.931230 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:20.932535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:20.932535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:20.932535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:20.932535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:20.932535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:20.932535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:20.932535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:20.932535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:20.932535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:20.932535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:20.932535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:20.932535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:20.932535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:20.932535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:20.932535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:20.932535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:20.933386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:20.933386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:20.933386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:20.933386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:20.933386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:20.933386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:20.933386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:20.933386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:20.934291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:20.934291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:20.934291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:20.934291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:20.934291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:20.934291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:20.934291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:20.934291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:20.934291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:20.934291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:20.934291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:20.934291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:20.934291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:20.934291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:36:20.934291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:36:20.934291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:20.935218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:20.936073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:20.936073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:20.936073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:21.186386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:21.186950 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:21.187506 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:21.187859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:21.188490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:21.188490 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:21.188490 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:21.188490 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:21.188490 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:21.188490 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:21.188490 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:21.188490 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:21.189279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:21.189279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:21.189279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:21.189279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:21.189279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:21.189279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:21.189279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:21.189279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:21.189279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:21.189279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:21.189279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:21.189279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:21.189279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:21.189279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:21.189279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:21.189279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:21.189956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:21.189956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:21.189956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:21.189956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:21.189956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:21.189956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:21.189956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:21.189956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:21.190416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:21.190416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:21.190416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:21.190416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:21.190416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:21.190416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:21.190416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:21.190416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:21.190416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:21.190416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:21.190416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:21.190416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:21.190416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:21.190416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:36:21.190416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:36:21.190416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:21.191159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:21.192063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:21.192063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:21.237616 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:21.238700 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:21.239390 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:21.239820 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:21.240081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:21.241011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:21.241011 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:21.241011 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:21.241011 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:21.241011 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:21.241011 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:21.241011 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:21.241011 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:21.242681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:21.242681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:21.242681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:21.242681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:21.242681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:21.242681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:21.242681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:21.242681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:21.242681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:21.242681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:21.242681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:21.242681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:21.242681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:21.242681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:36:21.242681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:21.242681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:21.242681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:21.243304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:25.800542 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:25.802463 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:25.835755 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:25.836389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:25.837794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:36:25.837794 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:25.837794 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:25.837794 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:25.837794 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:25.837794 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:25.837794 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:25.837794 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:25.838802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:25.838802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:25.838802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:25.838802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:25.838802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:25.838802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:25.838802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:25.838802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:25.838802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:25.838802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:25.838802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:25.838802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:25.838802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:25.838802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:36:25.838802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:25.838802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:25.838802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:25.839602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:25.878846 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:25.880459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:25.880806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:25.882010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:25.882010 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:25.882010 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:25.882010 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:25.882010 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:25.882010 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:25.882010 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:25.882010 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:25.884124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:25.884124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:25.884124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:25.884124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:25.884124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:25.884124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:25.884124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:25.884124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:25.884124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:25.884124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:25.884124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:25.884124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:25.884124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:25.884124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:36:25.884124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:25.884124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:25.884124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:25.885296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:25.931873 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:25.932512 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:36:25.933367 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:25.933703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:25.934664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:25.934664 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:25.934664 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:25.934664 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:25.934664 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:25.934664 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:25.934664 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:25.934664 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:25.936444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:25.936444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:25.936444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:25.936444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:25.936444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:25.936444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:25.936444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:25.936444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:25.936444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:25.936444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:25.936444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:25.936444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:25.936444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:25.936444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:25.936444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:25.936444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:25.937105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:25.937105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:25.937105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:25.937105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:25.937105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:25.937105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:25.937105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:25.937105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:25.939954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:25.939954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:25.939954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:25.939954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:25.939954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:25.939954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:25.939954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:25.939954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:25.939954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:25.939954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:25.939954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:25.939954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:25.939954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:25.939954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:36:25.939954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:36:25.939954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:25.941000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:25.942253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:25.942253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:25.942253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:26.188274 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:26.188631 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:26.189257 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:26.189647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:26.190486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:26.190486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:26.190486 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:26.190486 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:26.190486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:26.190486 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:26.190486 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:26.190486 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:26.191756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:26.191756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:26.191756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:26.191756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:26.191756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:26.191756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:26.191756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:26.191756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:26.191756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:26.191756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:26.191756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:26.191756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:26.191756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:26.191756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:26.191756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:26.191756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:26.192584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:26.192584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:26.192584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:26.192584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:26.192584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:26.192584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:26.192584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:26.192584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:26.192958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:26.192958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:26.192958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:26.192958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:26.192958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:26.192958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:26.192958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:26.192958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:26.192958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:26.192958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:26.192958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:26.192958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:26.192958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:26.192958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:36:26.192958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:36:26.192958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:26.193764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:26.194763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:26.194763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:26.239042 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:26.239931 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:26.240618 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:26.241126 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:26.241325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:26.242274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:26.242274 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:26.242274 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:26.242274 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:26.242274 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:26.242274 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:26.242274 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:26.242274 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:26.244656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:26.244656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:26.244656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:26.244656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:26.244656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:26.244656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:26.244656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:26.244656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:26.244656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:26.244656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:26.244656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:26.244656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:26.244656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:26.244656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:36:26.244656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:26.244656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:26.244656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:26.245695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:30.801746 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:30.803940 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:30.838026 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:30.838511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:30.840213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:36:30.840213 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:30.840213 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:30.840213 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:30.840213 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:30.840213 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:30.840213 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:30.840213 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:30.841346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:30.841346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:30.841346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:30.841346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:30.841346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:30.841346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:30.841346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:30.841346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:30.841346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:30.841346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:30.841346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:30.841346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:30.841346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:30.841346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:36:30.841346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:30.841346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:30.841346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:30.841692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:30.879862 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:30.881636 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:30.882020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:30.883007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:30.883007 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:30.883007 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:30.883007 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:30.883007 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:30.883007 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:30.883007 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:30.883007 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:30.885263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:30.885263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:30.885263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:30.885263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:30.885263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:30.885263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:30.885263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:30.885263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:30.885263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:30.885263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:30.885263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:30.885263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:30.885263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:30.885263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:36:30.885263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:30.885263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:30.885263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:30.886031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:30.932707 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:30.933527 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:36:30.934400 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:30.934778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:30.935731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:30.935731 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:30.935731 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:30.935731 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:30.935731 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:30.935731 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:30.935731 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:30.935731 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:30.937456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:30.937456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:30.937456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:30.937456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:30.937456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:30.937456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:30.937456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:30.937456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:30.937456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:30.937456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:30.937456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:30.937456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:30.937456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:30.937456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:30.937456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:30.937456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:30.938182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:30.938182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:30.938182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:30.938182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:30.938182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:30.938182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:30.938182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:30.938182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:30.939305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:30.939305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:30.939305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:30.939305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:30.939305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:30.939305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:30.939305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:30.939305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:30.939305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:30.939305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:30.939305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:30.939305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:30.939305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:30.939305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:36:30.939305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:36:30.939305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:30.940018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:30.940936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:30.940936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:30.940936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:31.189366 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:31.189943 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:31.190642 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:31.191220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:31.192519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:31.192519 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:31.192519 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:31.192519 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:31.192519 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:31.192519 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:31.192519 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:31.192519 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:31.193954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:31.193954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:31.193954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:31.193954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:31.193954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:31.193954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:31.193954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:31.193954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:31.193954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:31.193954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:31.193954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:31.193954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:31.193954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:31.193954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:31.193954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:31.193954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:31.194705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:31.194705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:31.194705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:31.194705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:31.194705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:31.194705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:31.194705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:31.194705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:31.195780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:31.195780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:31.195780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:31.195780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:31.195780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:31.195780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:31.195780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:31.195780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:31.195780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:31.195780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:31.195780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:31.195780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:31.195780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:31.195780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:36:31.195780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:36:31.195780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:31.196615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:31.197526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:31.197526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:31.240273 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:31.240812 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:31.241687 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:31.242125 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:31.242327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:31.243266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:31.243266 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:31.243266 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:31.243266 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:31.243266 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:31.243266 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:31.243266 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:31.243266 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:31.245311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:31.245311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:31.245311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:31.245311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:31.245311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:31.245311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:31.245311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:31.245311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:31.245311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:31.245311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:31.245311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:31.245311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:31.245311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:31.245311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:36:31.245311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:31.245311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:31.245311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:31.253677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:35.802660 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:35.804927 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:35.850496 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:35.850979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:35.851922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:36:35.851922 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:35.851922 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:35.851922 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:35.851922 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:35.851922 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:35.851922 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:35.851922 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:35.855449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:35.855449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:35.855449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:35.855449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:35.855449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:35.855449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:35.855449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:35.855449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:35.855449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:35.855449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:35.855449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:35.855449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:35.855449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:35.855449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:36:35.855449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:35.855449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:35.855449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:35.856311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:35.880657 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:35.881963 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:35.882351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:35.883332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:35.883332 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:35.883332 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:35.883332 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:35.883332 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:35.883332 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:35.883332 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:35.883332 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:35.885390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:35.885390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:35.885390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:35.885390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:35.885390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:35.885390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:35.885390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:35.885390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:35.885390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:35.885390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:35.885390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:35.885390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:35.885390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:35.885390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:36:35.885390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:35.885390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:35.885390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:35.886236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:35.933860 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:35.934345 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:36:35.934824 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:35.935160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:35.936009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:35.936009 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:35.936009 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:35.936009 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:35.936009 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:35.936009 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:35.936009 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:35.936009 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:35.937526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:35.937526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:35.937526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:35.937526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:35.937526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:35.937526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:35.937526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:35.937526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:35.937526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:35.937526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:35.937526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:35.937526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:35.937526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:35.937526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:35.937526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:35.937526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:35.939504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:35.939504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:35.939504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:35.939504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:35.939504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:35.939504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:35.939504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:35.939504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:35.940091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:35.940091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:35.940091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:35.940091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:35.940091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:35.940091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:35.940091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:35.940091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:35.940091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:35.940091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:35.940091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:35.940091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:35.940091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:35.940091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:36:35.940091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:36:35.940091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:35.941176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:35.942436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:35.942436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:35.942436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:36.190253 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:36.190901 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:36.191640 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:36.192254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:36.193412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:36.193412 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:36.193412 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:36.193412 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:36.193412 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:36.193412 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:36.193412 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:36.193412 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:36.194272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:36.194272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:36.194272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:36.194272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:36.194272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:36.194272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:36.194272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:36.194272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:36.194272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:36.194272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:36.194272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:36.194272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:36.194272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:36.194272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:36.194272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:36.194272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:36.195113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:36.195113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:36.195113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:36.195113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:36.195113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:36.195113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:36.195113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:36.195113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:36.195471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:36.195471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:36.195471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:36.195471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:36.195471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:36.195471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:36.195471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:36.195471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:36.195471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:36.195471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:36.195471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:36.195471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:36.195471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:36.195471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:36:36.195471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:36:36.195471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:36.196207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:36.197053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:36.197053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:36.241196 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:36.242060 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:36.242956 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:36.243410 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:36.243622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:36.244636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:36.244636 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:36.244636 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:36.244636 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:36.244636 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:36.244636 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:36.244636 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:36.244636 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:36.246696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:36.246696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:36.246696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:36.246696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:36.246696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:36.246696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:36.246696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:36.246696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:36.246696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:36.246696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:36.246696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:36.246696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:36.246696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:36.246696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:36:36.246696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:36.246696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:36.246696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:36.247531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:40.803409 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:40.804597 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:40.839346 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:40.839513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:40.839951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:36:40.839951 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:40.839951 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:40.839951 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:40.839951 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:40.839951 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:40.839951 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:40.839951 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:40.840777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:40.840777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:40.840777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:40.840777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:40.840777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:40.840777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:40.840777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:40.840777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:40.840777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:40.840777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:40.840777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:40.840777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:40.840777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:40.840777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:36:40.840777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:40.840777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:40.840777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:40.841691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:40.881302 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:40.883024 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:40.883396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:40.884303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:40.884303 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:40.884303 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:40.884303 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:40.884303 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:40.884303 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:40.884303 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:40.884303 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:40.885770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:40.885770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:40.885770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:40.885770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:40.885770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:40.885770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:40.885770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:40.885770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:40.885770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:40.885770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:40.885770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:40.885770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:40.885770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:40.885770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:36:40.885770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:40.885770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:40.885770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:40.886890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:40.934533 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:40.935173 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:36:40.935866 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:40.936298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:40.937220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:40.937220 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:40.937220 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:40.937220 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:40.937220 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:40.937220 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:40.937220 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:40.937220 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:40.938654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:40.938654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:40.938654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:40.938654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:40.938654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:40.938654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:40.938654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:40.938654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:40.938654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:40.938654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:40.938654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:40.938654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:40.938654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:40.938654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:40.938654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:40.938654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:40.939440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:40.939440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:40.939440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:40.939440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:40.939440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:40.939440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:40.939440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:40.939440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:40.940268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:40.940268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:40.940268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:40.940268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:40.940268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:40.940268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:40.940268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:40.940268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:40.940268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:40.940268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:40.940268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:40.940268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:40.940268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:40.940268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:36:40.940268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:36:40.940268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:40.941214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:40.942232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:40.942232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:40.942232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:41.191125 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:41.191683 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:41.192098 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:41.192416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:41.193308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:41.193308 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:41.193308 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:41.193308 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:41.193308 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:41.193308 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:41.193308 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:41.193308 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:41.195156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:41.195156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:41.195156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:41.195156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:41.195156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:41.195156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:41.195156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:41.195156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:41.195156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:41.195156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:41.195156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:41.195156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:41.195156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:41.195156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:41.195156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:41.195156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:41.196556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:41.196556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:41.196556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:41.196556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:41.196556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:41.196556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:41.196556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:41.196556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:41.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:41.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:41.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:41.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:41.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:41.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:41.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:41.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:41.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:41.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:41.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:41.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:41.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:41.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:36:41.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:36:41.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:41.198108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:41.198956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:41.198956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:41.242009 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:41.242587 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:41.243235 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:41.243763 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:41.244080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:41.245237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:41.245237 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:41.245237 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:41.245237 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:41.245237 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:41.245237 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:41.245237 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:41.245237 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:41.246865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:41.246865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:41.246865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:41.246865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:41.246865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:41.246865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:41.246865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:41.246865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:41.246865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:41.246865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:41.246865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:41.246865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:41.246865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:41.246865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:36:41.246865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:41.246865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:41.246865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:41.247803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:45.810476 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:45.812917 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:45.845600 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:45.847790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:45.847790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:36:45.847790 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:45.847790 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:45.847790 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:45.847790 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:45.847790 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:45.847790 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:45.847790 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:45.848901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:45.848901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:45.848901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:45.848901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:45.848901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:45.848901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:45.848901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:45.848901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:45.848901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:45.848901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:45.848901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:45.848901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:45.848901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:45.848901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:36:45.848901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:45.848901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:45.848901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:45.849676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:45.882163 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:45.883541 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:45.883973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:45.885402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:45.885402 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:45.885402 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:45.885402 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:45.885402 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:45.885402 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:45.885402 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:45.885402 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:45.887832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:45.887832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:45.887832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:45.887832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:45.887832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:45.887832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:45.887832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:45.887832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:45.887832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:45.887832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:45.887832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:45.887832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:45.887832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:45.887832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:36:45.887832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:45.887832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:45.887832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:45.888712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:45.935497 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:45.936095 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:36:45.936861 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:45.937317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:45.938373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:45.938373 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:45.938373 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:45.938373 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:45.938373 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:45.938373 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:45.938373 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:45.938373 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:45.940071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:45.940071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:45.940071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:45.940071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:45.940071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:45.940071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:45.940071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:45.940071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:45.940071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:45.940071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:45.940071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:45.940071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:45.940071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:45.940071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:45.940071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:45.940071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:45.940848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:45.940848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:45.940848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:45.940848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:45.940848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:45.940848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:45.940848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:45.940848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:45.942259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:45.942259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:45.942259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:45.942259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:45.942259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:45.942259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:45.942259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:45.942259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:45.942259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:45.942259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:45.942259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:45.942259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:45.942259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:45.942259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:36:45.942259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:36:45.942259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:45.943065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:45.943875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:45.943875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:45.943875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:46.192103 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:46.192737 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:46.193418 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:46.193842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:46.194713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:46.194713 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:46.194713 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:46.194713 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:46.194713 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:46.194713 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:46.194713 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:46.194713 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:46.196008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:46.196008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:46.196008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:46.196008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:46.196008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:46.196008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:46.196008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:46.196008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:46.196008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:46.196008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:46.196008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:46.196008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:46.196008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:46.196008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:46.196008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:46.196008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:46.196687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:46.196687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:46.196687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:46.196687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:46.196687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:46.196687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:46.196687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:46.196687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:46.197143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:46.197143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:46.197143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:46.197143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:46.197143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:46.197143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:46.197143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:46.197143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:46.197143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:46.197143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:46.197143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:46.197143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:46.197143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:46.197143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:36:46.197143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:36:46.197143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:46.197841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:46.198640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:46.198640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:46.242808 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:46.243664 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:46.244321 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:46.244783 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:46.244961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:46.245825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:46.245825 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:46.245825 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:46.245825 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:46.245825 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:46.245825 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:46.245825 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:46.245825 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:46.247902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:46.247902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:46.247902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:46.247902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:46.247902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:46.247902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:46.247902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:46.247902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:46.247902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:46.247902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:46.247902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:46.247902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:46.247902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:46.247902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:36:46.247902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:46.247902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:46.247902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:46.248653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:50.811361 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:50.814132 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4d2c9a67-f039-4057-a878-f3ca4d48758f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:50.853143 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:50.853143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:50.853143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4d2c9a67-f039-4057-a878-f3ca4d48758f None None] Traceback (most recent call last):
Apr 07 19:36:50.853143 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:50.853143 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:50.853143 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:50.853143 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:50.853143 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:50.853143 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:50.853143 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:50.853143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-4d2c9a67-f039-4057-a878-f3ca4d48758f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:50.853143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:50.853143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:50.853143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:50.854452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:50.856433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:50.856433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:50.856433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:50.856433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:50.856433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:50.856433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:50.856433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:50.856433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:50.856433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:50.856433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:50.856433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:50.856433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:50.883242 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:50.884505 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:50.884926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:50.886013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:50.886013 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:50.886013 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:50.886013 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:50.886013 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:50.886013 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:50.886013 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:50.886013 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:50.887850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:50.887850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:50.887850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:50.887850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:50.887850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:50.887850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:50.887850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:50.887850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:50.887850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:50.887850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:50.887850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:50.887850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:50.887850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:50.887850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:36:50.887850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:50.887850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:50.887850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:50.888434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:50.936314 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:50.936971 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:36:50.937774 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:50.938152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:50.939138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:50.939138 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:50.939138 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:50.939138 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:50.939138 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:50.939138 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:50.939138 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:50.939138 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:50.940593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:50.940593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:50.940593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:50.940593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:50.940593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:50.940593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:50.940593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:50.940593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:50.940593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:50.940593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:50.940593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:50.940593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:50.940593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:50.940593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:50.940593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:50.940593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:50.941234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:50.941234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:50.941234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:50.941234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:50.941234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:50.941234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:50.941234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:50.941234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:50.942355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:50.942355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:50.942355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:50.942355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:50.942355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:50.942355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:50.942355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:50.942355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:50.942355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:50.942355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:50.942355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:50.942355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:50.942355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:50.942355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:36:50.942355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:36:50.942355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:50.942837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:50.943396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:50.943396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:50.943396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:51.193369 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:51.193922 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:51.194666 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:51.195101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:51.196023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:51.196023 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:51.196023 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:51.196023 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:51.196023 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:51.196023 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:51.196023 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:51.196023 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:51.197517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:51.197517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:51.197517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:51.197517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:51.197517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:51.197517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:51.197517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:51.197517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:51.197517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:51.197517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:51.197517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:51.197517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:51.197517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:51.197517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:51.197517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:51.197517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:51.198329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:51.198329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:51.198329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:51.198329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:51.198329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:51.198329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:51.198329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:51.198329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:51.198881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:51.198881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:51.198881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:51.198881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:51.198881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:51.198881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:51.198881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:51.198881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:51.198881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:51.198881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:51.198881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:51.198881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:51.198881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:51.198881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:36:51.198881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:36:51.198881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:51.199674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:51.200630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:51.200630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:51.243684 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:51.244407 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:51.245113 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:51.245534 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:51.245777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:51.246671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:51.246671 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:51.246671 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:51.246671 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:51.246671 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:51.246671 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:51.246671 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:51.246671 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:51.248493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:51.248493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:51.248493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:51.248493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:51.248493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:51.248493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:51.248493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:51.248493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:51.248493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:51.248493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:51.248493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:51.248493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:51.248493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:51.248493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:36:51.248493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:51.248493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:51.248493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:51.249302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:55.812275 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:55.814172 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:55.851770 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:55.851962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:55.852501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:36:55.852501 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:55.852501 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:55.852501 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:55.852501 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:55.852501 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:55.852501 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:55.852501 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:55.853313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:55.853313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:55.853313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:55.853313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:55.853313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:55.853313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:55.853313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:55.853313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:55.853313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:55.853313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:55.853313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:55.853313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:55.853313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:55.853313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:36:55.853313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:55.853313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:55.853313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:55.853865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:55.883795 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:55.884886 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:55.885268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:55.886233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:55.886233 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:55.886233 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:55.886233 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:55.886233 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:55.886233 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:55.886233 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:55.886233 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:55.888144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:55.888144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:55.888144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:55.888144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:55.888144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:55.888144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:55.888144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:55.888144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:55.888144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:55.888144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:55.888144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:55.888144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:55.888144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:55.888144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:36:55.888144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:55.888144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:55.888144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:55.888642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:55.936920 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:55.937739 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:36:55.938383 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:55.938772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:55.939663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:55.939663 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:55.939663 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:55.939663 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:55.939663 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:55.939663 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:55.939663 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:55.939663 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:55.941194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:55.941194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:55.941194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:55.941194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:55.941194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:55.941194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:55.941194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:55.941194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:55.941194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:55.941194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:55.941194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:55.941194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:55.941194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:55.941194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:55.941194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:55.941194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:55.941688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:55.941688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:55.941688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:55.941688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:55.941688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:55.941688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:55.941688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:55.941688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:55.942850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:55.942850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:55.942850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:55.942850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:55.942850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:55.942850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:55.942850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:55.942850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:55.942850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:55.942850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:55.942850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:55.942850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:55.942850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:55.942850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:36:55.942850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:36:55.942850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:55.943281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:55.943755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:55.943755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:55.943755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:56.193825 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:56.195009 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:56.195528 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:56.195795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:56.196415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:56.196415 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:56.196415 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:56.196415 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:56.196415 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:56.196415 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:56.196415 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:56.196415 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:56.197734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:56.197734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:36:56.197734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:56.197734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:56.197734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:56.197734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:56.197734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:56.197734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:56.197734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:56.197734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:36:56.197734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:56.197734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:36:56.197734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:56.197734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:36:56.197734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:36:56.197734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:56.198295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:36:56.198295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:56.198295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:36:56.198295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:36:56.198295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:56.198295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:36:56.198295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:56.198295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:36:56.199017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:56.199017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:56.199017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:56.199017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:56.199017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:56.199017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:56.199017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:56.199017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:56.199017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:56.199017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:56.199017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:56.199017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:56.199017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:56.199017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:36:56.199017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:36:56.199017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:56.199837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:56.200783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:56.200783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:36:56.244248 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:36:56.244918 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:36:56.245451 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:56.245792 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:36:56.245980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:56.246813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:36:56.246813 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:56.246813 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:36:56.246813 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:36:56.246813 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:56.246813 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:36:56.246813 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:56.246813 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:36:56.248805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:56.248805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:36:56.248805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:36:56.248805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:36:56.248805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:36:56.248805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:36:56.248805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:56.248805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:36:56.248805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:36:56.248805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:36:56.248805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:36:56.248805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:36:56.248805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:36:56.248805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:36:56.248805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:36:56.248805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:56.248805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:36:56.249571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:00.813081 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:00.815269 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:00.852419 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:00.852885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:00.853724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:37:00.853724 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:00.853724 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:00.853724 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:00.853724 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:00.853724 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:00.853724 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:00.853724 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:00.854923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:00.854923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:00.854923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:00.854923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:00.854923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:00.854923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:00.854923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:00.854923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:00.854923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:00.854923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:00.854923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:00.854923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:00.854923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:00.854923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:37:00.854923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:00.854923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:00.854923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:00.855732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:00.884489 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:00.885482 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:00.885824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:00.886699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:00.886699 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:00.886699 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:00.886699 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:00.886699 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:00.886699 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:00.886699 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:00.886699 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:00.887940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:00.887940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:00.887940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:00.887940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:00.887940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:00.887940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:00.887940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:00.887940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:00.887940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:00.887940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:00.887940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:00.887940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:00.887940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:00.887940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:37:00.887940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:00.887940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:00.887940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:00.888939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:00.967152 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:00.967152 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:37:00.967610 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:00.967743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:00.968687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:00.968687 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:00.968687 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:00.968687 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:00.968687 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:00.968687 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:00.968687 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:00.968687 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:00.969676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:00.969676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:00.969676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:00.969676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:00.969676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:00.969676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:00.969676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:00.969676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:00.969676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:00.969676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:00.969676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:00.969676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:00.969676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:00.969676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:00.969676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:00.969676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:00.970071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:00.970071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:00.970071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:00.970071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:00.970071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:00.970071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:00.970071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:00.970071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:00.970475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:00.970475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:00.970475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:00.970475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:00.970475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:00.970475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:00.970475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:00.970475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:00.970475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:00.970475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:00.970475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:00.970475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:00.970475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:00.970475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:37:00.970475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:37:00.970475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:00.970821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:00.971248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:00.971248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:00.971248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:01.194611 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:01.194910 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:01.195573 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:01.196018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:01.196787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:01.196787 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:01.196787 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:01.196787 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:01.196787 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:01.196787 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:01.196787 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:01.196787 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:01.198294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:01.198294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:01.198294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:01.198294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:01.198294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:01.198294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:01.198294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:01.198294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:01.198294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:01.198294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:01.198294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:01.198294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:01.198294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:01.198294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:01.198294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:01.198294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:01.199109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:01.199109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:01.199109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:01.199109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:01.199109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:01.199109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:01.199109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:01.199109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:01.199891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:01.199891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:01.199891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:01.199891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:01.199891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:01.199891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:01.199891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:01.199891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:01.199891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:01.199891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:01.199891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:01.199891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:01.199891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:01.199891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:37:01.199891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:37:01.199891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:01.200753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:01.201701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:01.201701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:01.244918 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:01.245163 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:01.245527 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:01.245901 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:01.246080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:01.246874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:01.246874 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:01.246874 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:01.246874 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:01.246874 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:01.246874 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:01.246874 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:01.246874 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:01.247844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:01.247844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:01.247844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:01.247844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:01.247844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:01.247844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:01.247844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:01.247844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:01.247844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:01.247844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:01.247844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:01.247844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:01.247844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:01.247844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:37:01.247844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:01.247844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:01.247844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:01.248718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:05.813720 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:05.815349 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-92cafed4-ba6e-43f0-a08f-796ccf42fcee None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:05.885091 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:05.886231 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:05.886567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:05.887552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:05.887552 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:05.887552 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:05.887552 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:05.887552 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:05.887552 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:05.887552 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:05.887552 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:05.889449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:05.889449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:05.889449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:05.889449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:05.889449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:05.889449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:05.889449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:05.889449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:05.889449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:05.889449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:05.889449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:05.889449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:05.889449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:05.889449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:37:05.889449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:05.889449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:05.889449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:05.890554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:05.931524 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=241 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:37:05.959555 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:05.959940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:05.960840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-92cafed4-ba6e-43f0-a08f-796ccf42fcee None None] Traceback (most recent call last):
Apr 07 19:37:05.960840 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:05.960840 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:05.960840 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:05.960840 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:05.960840 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:05.960840 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:05.960840 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:05.962176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-92cafed4-ba6e-43f0-a08f-796ccf42fcee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:05.962176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:05.962176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:05.962176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:05.962176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:05.962176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:05.962176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:05.962176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:05.962176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:05.962176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:05.962176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:05.962176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:05.962176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:05.962176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:37:05.962176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:05.962176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:05.962176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:05.963321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:05.967286 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:05.967630 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:37:05.968215 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:05.968479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:05.969480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:05.969480 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:05.969480 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:05.969480 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:05.969480 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:05.969480 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:05.969480 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:05.969480 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:06.021919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:06.021919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:06.021919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:06.021919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:06.021919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:06.021919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:06.021919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:06.021919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:06.021919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:06.021919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:06.021919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:06.021919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:06.021919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:06.021919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:06.021919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:06.021919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:06.022719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:06.022719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:06.022719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:06.022719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:06.022719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:06.022719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:06.022719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:06.022719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:06.022719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:06.022719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:06.022719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:06.022719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:06.022719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:06.022719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:06.022719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:06.022719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:06.023443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:06.023974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:06.023974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:06.023974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:06.023974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:06.023974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:06.023974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:06.023974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:06.023974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:06.023974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:06.023974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:06.023974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:06.195096 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:06.195459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:06.196061 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:06.196458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:06.197180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:06.197180 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:06.197180 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:06.197180 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:06.197180 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:06.197180 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:06.197180 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:06.197180 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:06.198405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:06.198405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:06.198405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:06.198405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:06.198405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:06.198405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:06.198405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:06.198405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:06.198405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:06.198405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:06.198405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:06.198405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:06.198405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:06.198405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:06.198405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:06.198405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:06.199186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:06.199186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:06.199186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:06.199186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:06.199186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:06.199186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:06.199186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:06.199186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:06.200253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:06.200253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:06.200253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:06.200253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:06.200253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:06.200253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:06.200253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:06.200253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:06.200253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:06.200253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:06.200253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:06.200253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:06.200253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:06.200253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:37:06.200253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:37:06.200253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:06.200951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:06.201810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:06.201810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:06.245284 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:06.245592 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:06.245939 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:06.246381 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:06.246587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:06.247294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:06.247294 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:06.247294 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:06.247294 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:06.247294 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:06.247294 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:06.247294 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:06.247294 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:06.248837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:06.248837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:06.248837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:06.248837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:06.248837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:06.248837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:06.248837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:06.248837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:06.248837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:06.248837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:06.248837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:06.248837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:06.248837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:06.248837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:37:06.248837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:06.248837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:06.248837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:06.249641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:10.814387 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:10.816383 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:10.885777 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:10.886967 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:10.887292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:10.888344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:10.888344 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:10.888344 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:10.888344 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:10.888344 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:10.888344 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:10.888344 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:10.888344 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:10.891343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:10.891343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:10.891343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:10.891343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:10.891343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:10.891343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:10.891343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:10.891343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:10.891343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:10.891343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:10.891343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:10.891343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:10.891343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:10.891343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:37:10.891343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:10.891343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:10.891343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:10.892407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:10.906012 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:10.906317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:10.907028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Traceback (most recent call last):
Apr 07 19:37:10.907028 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:10.907028 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:10.907028 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:10.907028 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:10.907028 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:10.907028 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:10.907028 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:10.908452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:10.908452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:10.908452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:10.908452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:10.908452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:10.908452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:10.908452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:10.908452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:10.908452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:10.908452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:10.908452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:10.908452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:10.908452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:10.908452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:37:10.908452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:10.908452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:10.908452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:10.909350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:10.967971 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:10.968603 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:37:10.969368 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:10.969787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:10.971175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:10.971175 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:10.971175 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:10.971175 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:10.971175 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:10.971175 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:10.971175 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:10.971175 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:10.972429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:10.972429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:10.972429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:10.972429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:10.972429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:10.972429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:10.972429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:10.972429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:10.972429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:10.972429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:10.972429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:10.972429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:10.972429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:10.972429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:10.972429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:10.972429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:10.973391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:10.973391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:10.973391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:10.973391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:10.973391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:10.973391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:10.973391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:10.973391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:10.974176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:10.974176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:10.974176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:10.974176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:10.974176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:10.974176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:10.974176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:10.974176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:10.974176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:10.974176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:10.974176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:10.974176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:10.974176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:10.974176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:37:10.974176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:37:10.974176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:10.974935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:10.975976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:10.975976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:10.975976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:11.195721 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:11.196457 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:11.197163 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:11.197588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:11.198578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:11.198578 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:11.198578 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:11.198578 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:11.198578 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:11.198578 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:11.198578 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:11.198578 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:11.199805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:11.199805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:11.199805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:11.199805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:11.199805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:11.199805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:11.199805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:11.199805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:11.199805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:11.199805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:11.199805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:11.199805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:11.199805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:11.199805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:11.199805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:11.199805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:11.200702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:11.200702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:11.200702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:11.200702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:11.200702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:11.200702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:11.200702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:11.200702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:11.201761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:11.201761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:11.201761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:11.201761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:11.201761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:11.201761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:11.201761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:11.201761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:11.201761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:11.201761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:11.201761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:11.201761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:11.201761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:11.201761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:37:11.201761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:37:11.201761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:11.202533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:11.203449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:11.203449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:11.245804 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:11.246334 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:11.247093 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:11.247646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:11.247875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:11.248906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:11.248906 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:11.248906 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:11.248906 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:11.248906 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:11.248906 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:11.248906 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:11.248906 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:11.250751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:11.250751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:11.250751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:11.250751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:11.250751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:11.250751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:11.250751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:11.250751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:11.250751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:11.250751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:11.250751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:11.250751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:11.250751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:11.250751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:37:11.250751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:11.250751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:11.250751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:11.251598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:15.815110 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:15.819730 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:15.886614 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:15.887722 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:15.888069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:15.888894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:15.888894 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:15.888894 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:15.888894 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:15.888894 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:15.888894 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:15.888894 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:15.888894 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:15.890747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:15.890747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:15.890747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:15.890747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:15.890747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:15.890747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:15.890747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:15.890747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:15.890747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:15.890747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:15.890747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:15.890747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:15.890747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:15.890747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:37:15.890747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:15.890747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:15.890747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:15.891521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:15.917747 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:15.919432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:15.920404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:37:15.920404 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:15.920404 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:15.920404 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:15.920404 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:15.920404 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:15.920404 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:15.920404 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:15.921583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:15.921583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:15.921583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:15.921583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:15.921583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:15.921583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:15.921583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:15.921583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:15.921583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:15.921583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:15.921583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:15.921583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:15.921583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:15.921583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:37:15.921583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:15.921583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:15.921583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:15.922733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:15.968709 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:15.969161 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:37:15.969807 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:15.970046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:15.970709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Traceback (most recent call last):
Apr 07 19:37:15.970709 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:15.970709 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:15.970709 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:15.970709 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:15.970709 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:15.970709 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:15.970709 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:15.972227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:15.972227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:15.972227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:15.972227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:15.972227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:15.972227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:15.972227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:15.972227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:15.972227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:15.972227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:15.972227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:15.972227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:15.972227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:15.972227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:15.972227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:15.972737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:15.972737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:15.972737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:15.972737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:15.972737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:15.972737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:15.972737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:15.972737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:15.972737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:15.974612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:15.974612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:15.974612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:15.974612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:15.974612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:15.974612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:15.974612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:15.974612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:15.974612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:15.974612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:15.974612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:15.974612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:15.974612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:15.974612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:37:15.974612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:37:15.974612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:15.975635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:15.976542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:15.976542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:15.976542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:16.196458 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:16.196862 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:16.198251 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:16.198726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:16.199735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:16.199735 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:16.199735 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:16.199735 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:16.199735 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:16.199735 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:16.199735 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:16.199735 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:16.201189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:16.201189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:16.201189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:16.201189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:16.201189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:16.201189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:16.201189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:16.201189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:16.201189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:16.201189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:16.201189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:16.201189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:16.201189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:16.201189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:16.201189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:16.201189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:16.201911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:16.201911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:16.201911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:16.201911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:16.201911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:16.201911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:16.201911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:16.201911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:16.202935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:16.202935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:16.202935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:16.202935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:16.202935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:16.202935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:16.202935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:16.202935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:16.202935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:16.202935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:16.202935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:16.202935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:16.202935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:16.202935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:37:16.202935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:37:16.202935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:16.203789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:16.204619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:16.204619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:16.246429 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:16.246808 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:16.248153 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:16.248628 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:16.248846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:16.249935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:16.249935 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:16.249935 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:16.249935 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:16.249935 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:16.249935 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:16.249935 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:16.249935 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:16.251703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:16.251703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:16.251703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:16.251703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:16.251703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:16.251703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:16.251703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:16.251703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:16.251703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:16.251703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:16.251703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:16.251703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:16.251703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:16.251703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:37:16.251703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:16.251703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:16.251703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:16.252567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:20.816316 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:20.817849 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:20.857370 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:20.857766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:20.859237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Traceback (most recent call last):
Apr 07 19:37:20.859237 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:20.859237 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:20.859237 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:20.859237 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:20.859237 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:20.859237 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:20.859237 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:20.860642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:20.860642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:20.860642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:20.860642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:20.860642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:20.860642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:20.860642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:20.860642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:20.860642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:20.860642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:20.860642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:20.860642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:20.860642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:20.860642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:37:20.860642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:20.860642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:20.860642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:20.861223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:20.887159 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:20.888351 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:20.888664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:20.891394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:20.892560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:20.893668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:20.893668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:20.893668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:20.893668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:20.969416 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:20.969923 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:37:20.970300 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:20.970625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:20.973029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:20.973563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:20.973563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:20.973563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:20.973563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:20.973563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:20.973563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:20.973563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:20.973563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:20.973563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:20.973563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:20.973563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:20.973563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:20.973563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:20.973563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:20.973563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:20.973957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:20.974503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:20.974503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:20.974503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:20.974503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:20.974503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:20.974503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:20.974503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:20.974503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:20.974503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:20.974503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:20.974503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:20.974503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:20.974503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:20.974503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:20.974503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:20.974503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:20.974503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:21.198490 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:21.199979 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:21.201021 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:21.201490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:21.202498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:21.202498 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:21.202498 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:21.202498 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:21.202498 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:21.202498 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:21.202498 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:21.202498 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:21.204037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:21.204037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:21.204037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:21.204037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:21.204037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:21.204037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:21.204037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:21.204037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:21.204037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:21.204037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:21.204037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:21.204037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:21.204037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:21.204037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:21.204037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:21.204037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:21.204766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:21.204766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:21.204766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:21.204766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:21.204766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:21.204766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:21.204766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:21.204766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:21.206460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:21.206460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:21.206460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:21.206460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:21.206460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:21.206460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:21.206460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:21.206460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:21.206460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:21.206460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:21.206460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:21.206460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:21.206460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:21.206460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:37:21.206460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:37:21.206460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:21.207470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:21.208388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:21.208388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:21.247070 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:21.247760 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:21.248174 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:21.248429 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:21.248582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:21.249228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:21.249228 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:21.249228 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:21.249228 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:21.249228 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:21.249228 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:21.249228 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:21.249228 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:21.251640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:21.251640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:21.251640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:21.251640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:21.251640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:21.251640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:21.251640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:21.251640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:21.251640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:21.251640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:21.251640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:21.251640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:21.251640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:21.251640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:37:21.251640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:21.251640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:21.251640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:21.252638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:25.817118 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:25.819045 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:25.851806 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:25.852304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:25.853237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:37:25.853237 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:25.853237 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:25.853237 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:25.853237 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:25.853237 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:25.853237 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:25.853237 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:25.854397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:25.854397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:25.854397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:25.854397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:25.854397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:25.854397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:25.854397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:25.854397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:25.854397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:25.854397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:25.854397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:25.854397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:25.854397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:25.854397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:37:25.854397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:25.854397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:25.854397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:25.855254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:25.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:25.889011 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:25.889497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:25.890348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:25.890348 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:25.890348 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:25.890348 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:25.890348 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:25.890348 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:25.890348 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:25.890348 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:25.891490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:25.891490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:25.891490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:25.891490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:25.891490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:25.891490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:25.891490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:25.891490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:25.891490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:25.891490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:25.891490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:25.891490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:25.891490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:25.891490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:37:25.891490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:25.891490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:25.891490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:25.892476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:25.970065 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:25.970686 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:37:25.971110 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:25.971298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:25.971813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:25.971813 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:25.971813 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:25.971813 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:25.971813 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:25.971813 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:25.971813 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:25.971813 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:25.973082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:25.973082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:25.973082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:25.973082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:25.973082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:25.973082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:25.973082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:25.973082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:25.973082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:25.973082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:25.973082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:25.973082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:25.973082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:25.973082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:25.973082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:25.973082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:25.973822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:25.973822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:25.973822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:25.973822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:25.973822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:25.973822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:25.973822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:25.973822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:25.974566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:25.974566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:25.974566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:25.974566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:25.974566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:25.974566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:25.974566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:25.974566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:25.974566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:25.974566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:25.974566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:25.974566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:25.974566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:25.974566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:37:25.974566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:37:25.974566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:25.975548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:25.976469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:25.976469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:25.976469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:26.199917 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:26.200524 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:26.201401 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:26.201859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:26.202840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:26.202840 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:26.202840 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:26.202840 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:26.202840 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:26.202840 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:26.202840 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:26.202840 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:26.204169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:26.204169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:26.204169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:26.204169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:26.204169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:26.204169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:26.204169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:26.204169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:26.204169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:26.204169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:26.204169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:26.204169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:26.204169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:26.204169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:26.204169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:26.204169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:26.204607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:26.204607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:26.204607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:26.204607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:26.204607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:26.204607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:26.204607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:26.204607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:26.205702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:26.205702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:26.205702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:26.205702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:26.205702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:26.205702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:26.205702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:26.205702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:26.205702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:26.205702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:26.205702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:26.205702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:26.205702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:26.205702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:37:26.205702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:37:26.205702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:26.206350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:26.206856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:26.206856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:26.248054 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:26.248624 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:26.249476 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:26.250126 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:26.250499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:26.251503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:26.251503 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:26.251503 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:26.251503 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:26.251503 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:26.251503 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:26.251503 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:26.251503 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:26.253348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:26.253348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:26.253348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:26.253348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:26.253348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:26.253348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:26.253348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:26.253348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:26.253348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:26.253348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:26.253348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:26.253348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:26.253348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:26.253348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:37:26.253348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:26.253348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:26.253348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:26.254526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:30.818078 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:30.819924 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:30.853686 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:30.854038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:30.854884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:37:30.854884 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:30.854884 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:30.854884 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:30.854884 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:30.854884 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:30.854884 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:30.854884 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:30.855807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:30.855807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:30.855807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:30.855807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:30.855807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:30.855807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:30.855807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:30.855807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:30.855807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:30.855807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:30.855807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:30.855807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:30.855807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:30.855807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:37:30.855807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:30.855807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:30.855807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:30.856316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:30.888750 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:30.890116 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:30.890448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:30.891522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:30.891522 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:30.891522 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:30.891522 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:30.891522 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:30.891522 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:30.891522 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:30.891522 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:30.893397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:30.893397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:30.893397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:30.893397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:30.893397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:30.893397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:30.893397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:30.893397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:30.893397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:30.893397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:30.893397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:30.893397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:30.893397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:30.893397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:37:30.893397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:30.893397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:30.893397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:30.894216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:30.971032 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:30.971536 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:37:30.972288 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:30.972606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:30.973437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:30.973437 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:30.973437 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:30.973437 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:30.973437 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:30.973437 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:30.973437 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:30.973437 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:30.974832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:30.974832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:30.974832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:30.974832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:30.974832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:30.974832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:30.974832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:30.974832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:30.974832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:30.974832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:30.974832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:30.974832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:30.974832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:30.974832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:30.974832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:30.974832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:30.975391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:30.975391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:30.975391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:30.975391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:30.975391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:30.975391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:30.975391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:30.975391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:30.976449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:30.976449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:30.976449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:30.976449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:30.976449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:30.976449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:30.976449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:30.976449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:30.976449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:30.976449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:30.976449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:30.976449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:30.976449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:30.976449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:37:30.976449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:37:30.976449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:30.976903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:30.977548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:30.977548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:30.977548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:31.200624 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:31.201263 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:31.202062 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:31.202548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:31.203529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:31.203529 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:31.203529 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:31.203529 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:31.203529 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:31.203529 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:31.203529 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:31.203529 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:31.204523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:31.204523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:31.204523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:31.204523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:31.204523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:31.204523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:31.204523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:31.204523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:31.204523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:31.204523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:31.204523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:31.204523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:31.204523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:31.204523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:31.204523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:31.204523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:31.204977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:31.204977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:31.204977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:31.204977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:31.204977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:31.204977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:31.204977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:31.204977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:31.205921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:31.205921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:31.205921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:31.205921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:31.205921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:31.205921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:31.205921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:31.205921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:31.205921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:31.205921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:31.205921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:31.205921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:31.205921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:31.205921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:37:31.205921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:37:31.205921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:31.206408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:31.206959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:31.206959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:31.248647 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:31.249296 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:31.249885 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:31.250213 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:31.250337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:31.251109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:31.251109 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:31.251109 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:31.251109 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:31.251109 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:31.251109 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:31.251109 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:31.251109 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:31.253133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:31.253133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:31.253133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:31.253133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:31.253133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:31.253133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:31.253133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:31.253133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:31.253133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:31.253133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:31.253133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:31.253133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:31.253133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:31.253133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:37:31.253133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:31.253133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:31.253133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:31.253835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:35.818712 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:35.821215 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:35.850450 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:35.850714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:35.851546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:37:35.851546 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:35.851546 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:35.851546 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:35.851546 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:35.851546 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:35.851546 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:35.851546 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:35.852939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:35.852939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:35.852939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:35.852939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:35.852939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:35.852939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:35.852939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:35.852939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:35.852939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:35.852939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:35.852939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:35.852939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:35.852939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:35.852939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:37:35.852939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:35.852939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:35.852939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:35.853470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:35.889346 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:35.890728 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:35.891151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:35.892126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:35.892126 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:35.892126 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:35.892126 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:35.892126 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:35.892126 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:35.892126 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:35.892126 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:35.894276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:35.894276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:35.894276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:35.894276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:35.894276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:35.894276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:35.894276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:35.894276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:35.894276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:35.894276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:35.894276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:35.894276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:35.894276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:35.894276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:37:35.894276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:35.894276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:35.894276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:35.894767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:35.971634 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:35.972007 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:37:35.972835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:35.973118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:35.974417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:35.974417 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:35.974417 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:35.974417 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:35.974417 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:35.974417 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:35.974417 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:35.974417 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:35.975690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:35.975690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:35.975690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:35.975690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:35.975690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:35.975690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:35.975690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:35.975690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:35.975690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:35.975690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:35.975690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:35.975690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:35.975690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:35.975690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:35.975690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:35.975690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:35.976430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:35.976430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:35.976430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:35.976430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:35.976430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:35.976430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:35.976430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:35.976430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:35.977225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:35.977225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:35.977225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:35.977225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:35.977225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:35.977225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:35.977225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:35.977225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:35.977225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:35.977225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:35.977225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:35.977225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:35.977225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:35.977225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:37:35.977225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:37:35.977225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:35.977691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:35.978193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:35.978193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:35.978193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:36.201458 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:36.201888 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:36.202577 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:36.202885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:36.203471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:36.203471 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:36.203471 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:36.203471 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:36.203471 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:36.203471 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:36.203471 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:36.203471 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:36.204364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:36.204364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:36.204364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:36.204364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:36.204364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:36.204364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:36.204364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:36.204364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:36.204364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:36.204364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:36.204364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:36.204364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:36.204364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:36.204364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:36.204364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:36.204364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:36.205224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:36.205224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:36.205224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:36.205224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:36.205224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:36.205224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:36.205224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:36.205224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:36.205563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:36.205563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:36.205563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:36.205563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:36.205563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:36.205563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:36.205563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:36.205563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:36.205563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:36.205563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:36.205563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:36.205563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:36.205563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:36.205563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:37:36.205563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:37:36.205563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:36.206229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:36.207035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:36.207035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:36.249241 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:36.249563 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:36.250230 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:36.250539 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:36.250678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:36.251355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:36.251355 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:36.251355 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:36.251355 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:36.251355 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:36.251355 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:36.251355 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:36.251355 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:36.253662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:36.253662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:36.253662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:36.253662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:36.253662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:36.253662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:36.253662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:36.253662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:36.253662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:36.253662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:36.253662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:36.253662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:36.253662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:36.253662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:37:36.253662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:36.253662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:36.253662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:36.254464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:40.819705 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:40.821515 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:40.851017 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:40.851390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:40.852265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:37:40.852265 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:40.852265 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:40.852265 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:40.852265 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:40.852265 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:40.852265 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:40.852265 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:40.853336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:40.853336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:40.853336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:40.853336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:40.853336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:40.853336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:40.853336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:40.853336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:40.853336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:40.853336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:40.853336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:40.853336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:40.853336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:40.853336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:37:40.853336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:40.853336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:40.853336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:40.854083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:40.890037 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:40.891566 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:40.891977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:40.892922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:40.892922 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:40.892922 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:40.892922 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:40.892922 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:40.892922 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:40.892922 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:40.892922 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:40.894455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:40.894455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:40.894455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:40.894455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:40.894455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:40.894455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:40.894455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:40.894455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:40.894455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:40.894455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:40.894455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:40.894455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:40.894455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:40.894455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:37:40.894455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:40.894455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:40.894455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:40.895161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:40.974191 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:40.974850 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:37:40.975531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:40.975900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:40.976781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:40.976781 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:40.976781 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:40.976781 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:40.976781 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:40.976781 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:40.976781 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:40.976781 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:40.977942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:40.977942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:40.977942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:40.977942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:40.977942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:40.977942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:40.977942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:40.977942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:40.977942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:40.977942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:40.977942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:40.977942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:40.977942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:40.977942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:40.977942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:40.977942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:40.978836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:40.978836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:40.978836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:40.978836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:40.978836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:40.978836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:40.978836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:40.978836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:40.979771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:40.979771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:40.979771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:40.979771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:40.979771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:40.979771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:40.979771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:40.979771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:40.979771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:40.979771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:40.979771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:40.979771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:40.979771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:40.979771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:37:40.979771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:37:40.979771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:40.980592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:40.981585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:40.981585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:40.981585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:41.224976 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:41.224976 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:41.224976 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:41.224976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:41.224976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:41.224976 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:41.224976 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:41.224976 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:41.224976 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:41.224976 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:41.224976 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:41.224976 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:41.227472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:41.227472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:41.227472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:41.227472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:41.227472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:41.227472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:41.227472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:41.227472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:41.227472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:41.227472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:41.227472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:41.227472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:41.227472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:41.227472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:41.227472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:41.227472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:41.228020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:41.228020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:41.228020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:41.228020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:41.228020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:41.228020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:41.228020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:41.228020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:41.228020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:41.228020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:41.228020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:41.228020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:41.228020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:41.228020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:41.228020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:41.228020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:41.228514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:41.229124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:41.229124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:41.229124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:41.229124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:41.229124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:41.229124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:41.229124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:41.229124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:41.229124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:41.250208 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:41.250729 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:41.251587 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:41.252046 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:41.252282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:41.256241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:41.256241 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:41.256241 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:41.256241 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:41.256241 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:41.256241 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:41.256241 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:41.256241 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:41.256603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:41.256603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:41.256603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:41.256603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:41.256603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:41.256603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:41.256603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:41.256603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:41.256603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:41.256603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:41.256603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:41.256603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:41.256603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:41.256603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:37:41.256603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:41.256603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:41.256603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:41.257208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:45.820338 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:45.821948 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:45.853104 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:45.853552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:45.854626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:37:45.854626 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:45.854626 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:45.854626 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:45.854626 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:45.854626 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:45.854626 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:45.854626 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:45.855771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:45.855771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:45.855771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:45.855771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:45.855771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:45.855771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:45.855771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:45.855771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:45.855771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:45.855771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:45.855771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:45.855771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:45.855771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:45.855771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:37:45.855771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:45.855771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:45.855771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:45.856600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:45.890751 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:45.891552 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:45.891754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:45.892759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:45.892759 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:45.892759 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:45.892759 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:45.892759 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:45.892759 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:45.892759 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:45.892759 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:45.894094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:45.894094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:45.894094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:45.894094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:45.894094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:45.894094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:45.894094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:45.894094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:45.894094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:45.894094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:45.894094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:45.894094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:45.894094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:45.894094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:37:45.894094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:45.894094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:45.894094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:45.895116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:45.975126 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:45.975723 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:37:45.976459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:45.976888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:45.977888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Traceback (most recent call last):
Apr 07 19:37:45.977888 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:45.977888 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:45.977888 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:45.977888 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:45.977888 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:45.977888 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:45.977888 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:45.979128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:45.979128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:45.979128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:45.979128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:45.979128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:45.979128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:45.979128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:45.979128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:45.979128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:45.979128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:45.979128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:45.979128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:45.979128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:45.979128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:45.979128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:45.979579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:45.979579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:45.979579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:45.979579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:45.979579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:45.979579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:45.979579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:45.979579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:45.979579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:45.980149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:45.980149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:45.980149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:45.980149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:45.980149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:45.980149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:45.980149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:45.980149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:45.980149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:45.980149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:45.980149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:45.980149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:45.980149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:45.980149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:37:45.980149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:37:45.980149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:45.980565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:45.981123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:45.981123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:45.981123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:46.209924 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:46.210548 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:46.211415 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:46.211892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:46.212808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:46.212808 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:46.212808 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:46.212808 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:46.212808 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:46.212808 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:46.212808 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:46.212808 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:46.214224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:46.214224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:46.214224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:46.214224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:46.214224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:46.214224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:46.214224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:46.214224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:46.214224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:46.214224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:46.214224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:46.214224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:46.214224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:46.214224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:46.214224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:46.214224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:46.215017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:46.215017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:46.215017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:46.215017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:46.215017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:46.215017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:46.215017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:46.215017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:46.216149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:46.216149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:46.216149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:46.216149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:46.216149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:46.216149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:46.216149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:46.216149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:46.216149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:46.216149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:46.216149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:46.216149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:46.216149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:46.216149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:37:46.216149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:37:46.216149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:46.216756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:46.217256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:46.217256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:46.250669 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:46.251432 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:46.252012 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:46.252533 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:46.252753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:46.253587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:46.253587 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:46.253587 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:46.253587 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:46.253587 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:46.253587 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:46.253587 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:46.253587 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:46.255527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:46.255527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:46.255527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:46.255527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:46.255527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:46.255527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:46.255527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:46.255527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:46.255527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:46.255527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:46.255527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:46.255527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:46.255527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:46.255527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:37:46.255527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:46.255527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:46.255527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:46.256553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:50.821185 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:50.823025 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:50.856423 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:50.856621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:50.857142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:37:50.857142 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:50.857142 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:50.857142 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:50.857142 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:50.857142 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:50.857142 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:50.857142 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:50.857909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:50.857909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:50.857909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:50.857909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:50.857909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:50.857909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:50.857909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:50.857909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:50.857909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:50.857909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:50.857909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:50.857909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:50.857909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:50.857909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:37:50.857909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:50.857909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:50.857909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:50.858825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:50.891558 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:50.892672 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:50.892930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:50.893685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:50.893685 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:50.893685 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:50.893685 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:50.893685 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:50.893685 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:50.893685 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:50.893685 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:50.895318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:50.895318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:50.895318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:50.895318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:50.895318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:50.895318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:50.895318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:50.895318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:50.895318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:50.895318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:50.895318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:50.895318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:50.895318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:50.895318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:37:50.895318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:50.895318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:50.895318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:50.896177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:50.975860 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:50.976617 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:37:50.977426 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:50.977756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:50.978574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Traceback (most recent call last):
Apr 07 19:37:50.978574 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:50.978574 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:50.978574 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:50.978574 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:50.978574 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:50.978574 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:50.978574 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:50.979509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:50.979509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:50.979509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:50.979509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:50.979509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:50.979509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:50.979509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:50.979509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:50.979509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:50.979509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:50.979509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:50.979509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:50.979509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:50.979509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:50.979509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:50.980552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:50.980552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:50.980552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:50.980552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:50.980552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:50.980552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:50.980552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:50.980552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:50.980552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:50.980979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:50.980979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:50.980979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:50.980979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:50.980979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:50.980979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:50.980979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:50.980979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:50.980979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:50.980979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:50.980979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:50.980979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:50.980979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:50.980979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:37:50.980979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:37:50.980979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:50.981869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:50.982954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:50.982954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:50.982954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:51.210761 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:51.211463 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:51.212334 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:51.212834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:51.213702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:51.213702 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:51.213702 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:51.213702 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:51.213702 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:51.213702 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:51.213702 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:51.213702 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:51.215243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:51.215243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:51.215243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:51.215243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:51.215243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:51.215243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:51.215243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:51.215243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:51.215243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:51.215243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:51.215243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:51.215243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:51.215243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:51.215243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:51.215243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:51.215243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:51.216276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:51.216276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:51.216276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:51.216276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:51.216276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:51.216276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:51.216276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:51.216276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:51.217144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:51.217144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:51.217144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:51.217144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:51.217144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:51.217144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:51.217144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:51.217144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:51.217144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:51.217144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:51.217144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:51.217144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:51.217144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:51.217144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:37:51.217144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:37:51.217144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:51.218041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:51.218934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:51.218934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:51.251469 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:51.252259 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:51.252854 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:51.253648 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:51.253881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:51.254873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:51.254873 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:51.254873 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:51.254873 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:51.254873 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:51.254873 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:51.254873 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:51.254873 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:51.256792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:51.256792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:51.256792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:51.256792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:51.256792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:51.256792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:51.256792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:51.256792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:51.256792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:51.256792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:51.256792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:51.256792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:51.256792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:51.256792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:37:51.256792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:51.256792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:51.256792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:51.257647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:55.821929 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:55.823377 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:55.850614 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:55.851009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:55.851892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:37:55.851892 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:55.851892 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:55.851892 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:55.851892 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:55.851892 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:55.851892 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:55.851892 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:55.852814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:55.852814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:55.852814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:55.852814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:55.852814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:55.852814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:55.852814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:55.852814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:55.852814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:55.852814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:55.852814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:55.852814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:55.852814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:55.852814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:37:55.852814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:55.852814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:55.852814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:55.853586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:55.892563 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:55.893597 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:55.893776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:55.894443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:55.894443 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:55.894443 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:55.894443 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:55.894443 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:55.894443 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:55.894443 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:55.894443 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:55.896511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:55.896511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:55.896511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:55.896511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:55.896511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:55.896511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:55.896511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:55.896511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:55.896511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:55.896511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:55.896511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:55.896511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:55.896511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:55.896511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:37:55.896511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:55.896511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:55.896511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:55.897350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:55.976827 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:55.977596 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:37:55.978194 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:55.978492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:55.979288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Traceback (most recent call last):
Apr 07 19:37:55.979288 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:55.979288 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:55.979288 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:55.979288 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:55.979288 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:55.979288 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:55.979288 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:55.980858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:55.980858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:55.980858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:55.980858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:55.980858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:55.980858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:55.980858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:55.980858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:55.980858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:55.980858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:55.980858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:55.980858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:55.980858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:55.980858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:55.980858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:55.981882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:55.981882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:55.981882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:55.981882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:55.981882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:55.981882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:55.981882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:55.981882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:55.981882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:55.983091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:55.983091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:55.983091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:55.983091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:55.983091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:55.983091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:55.983091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:55.983091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:55.983091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:55.983091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:55.983091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:55.983091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:55.983091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:55.983091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:37:55.983091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:37:55.983091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:55.983882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:55.984886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:55.984886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:55.984886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:56.211713 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:56.212508 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:56.213384 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:56.213809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:56.214670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:56.214670 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:56.214670 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:56.214670 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:56.214670 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:56.214670 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:56.214670 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:56.214670 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:56.216003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:56.216003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:37:56.216003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:56.216003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:56.216003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:56.216003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:56.216003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:56.216003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:56.216003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:56.216003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:37:56.216003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:56.216003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:37:56.216003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:56.216003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:37:56.216003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:37:56.216003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:56.216792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:37:56.216792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:56.216792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:37:56.216792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:37:56.216792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:56.216792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:37:56.216792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:56.216792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:37:56.217636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:56.217636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:56.217636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:56.217636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:56.217636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:56.217636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:56.217636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:56.217636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:56.217636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:56.217636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:56.217636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:56.217636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:56.217636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:56.217636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:37:56.217636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:37:56.217636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:56.218418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:56.219215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:56.219215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:37:56.252291 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:37:56.253012 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:37:56.253736 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:56.254042 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:37:56.254116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:56.254904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:37:56.254904 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:56.254904 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:37:56.254904 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:37:56.254904 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:56.254904 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:37:56.254904 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:56.254904 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:37:56.256789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:56.256789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:37:56.256789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:37:56.256789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:37:56.256789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:37:56.256789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:37:56.256789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:56.256789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:37:56.256789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:37:56.256789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:37:56.256789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:37:56.256789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:37:56.256789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:37:56.256789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:37:56.256789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:37:56.256789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:56.256789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:37:56.258175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:00.822667 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:00.825020 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:00.868609 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:00.868842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:00.869611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:38:00.869611 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:00.869611 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:00.869611 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:00.869611 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:00.869611 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:00.869611 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:00.869611 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:00.870822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:00.870822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:00.870822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:00.870822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:00.870822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:00.870822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:00.870822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:00.870822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:00.870822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:00.870822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:00.870822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:00.870822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:00.870822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:00.870822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:38:00.870822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:00.870822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:00.870822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:00.871443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:00.893460 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:00.894390 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:00.894591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:00.895202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:00.895202 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:00.895202 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:00.895202 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:00.895202 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:00.895202 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:00.895202 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:00.895202 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:00.896518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:00.896518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:00.896518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:00.896518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:00.896518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:00.896518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:00.896518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:00.896518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:00.896518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:00.896518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:00.896518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:00.896518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:00.896518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:00.896518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:38:00.896518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:00.896518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:00.896518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:00.897194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:00.977697 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:00.978364 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:38:00.979341 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:00.979739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:00.980771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:00.980771 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:00.980771 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:00.980771 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:00.980771 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:00.980771 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:00.980771 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:00.980771 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:00.982178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:00.982178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:00.982178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:00.982178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:00.982178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:00.982178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:00.982178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:00.982178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:00.982178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:00.982178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:00.982178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:00.982178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:00.982178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:00.982178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:00.982178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:00.982178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:00.982882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:00.982882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:00.982882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:00.982882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:00.982882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:00.982882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:00.982882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:00.982882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:00.983703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:00.983703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:00.983703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:00.983703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:00.983703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:00.983703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:00.983703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:00.983703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:00.983703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:00.983703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:00.983703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:00.983703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:00.983703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:00.983703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:38:00.983703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:38:00.983703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:00.984261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:00.984866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:00.984866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:00.984866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:01.212578 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:01.213350 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:01.214124 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:01.214427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:01.215184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:01.215184 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:01.215184 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:01.215184 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:01.215184 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:01.215184 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:01.215184 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:01.215184 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:01.216597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:01.216597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:01.216597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:01.216597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:01.216597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:01.216597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:01.216597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:01.216597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:01.216597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:01.216597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:01.216597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:01.216597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:01.216597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:01.216597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:01.216597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:01.216597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:01.217428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:01.217428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:01.217428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:01.217428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:01.217428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:01.217428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:01.217428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:01.217428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:01.218463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:01.218463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:01.218463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:01.218463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:01.218463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:01.218463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:01.218463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:01.218463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:01.218463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:01.218463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:01.218463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:01.218463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:01.218463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:01.218463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:38:01.218463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:38:01.218463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:01.219537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:01.220399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:01.220399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:01.253201 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:01.253733 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:01.254294 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:01.254644 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:01.254842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:01.255682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:01.255682 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:01.255682 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:01.255682 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:01.255682 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:01.255682 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:01.255682 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:01.255682 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:01.257438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:01.257438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:01.257438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:01.257438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:01.257438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:01.257438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:01.257438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:01.257438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:01.257438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:01.257438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:01.257438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:01.257438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:01.257438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:01.257438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:38:01.257438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:01.257438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:01.257438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:01.258233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:05.823724 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:05.825872 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:05.861100 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:05.861100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:05.861869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:38:05.861869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:05.861869 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:05.861869 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:05.861869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:05.861869 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:05.861869 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:05.861869 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:05.862788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:05.862788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:05.862788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:05.862788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:05.862788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:05.862788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:05.862788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:05.862788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:05.862788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:05.862788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:05.862788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:05.862788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:05.862788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:05.862788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:38:05.862788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:05.862788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:05.862788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:05.863499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:05.894263 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:05.895515 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:05.895888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:05.896679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:05.896679 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:05.896679 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:05.896679 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:05.896679 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:05.896679 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:05.896679 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:05.896679 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:05.898593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:05.898593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:05.898593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:05.898593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:05.898593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:05.898593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:05.898593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:05.898593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:05.898593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:05.898593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:05.898593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:05.898593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:05.898593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:05.898593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:38:05.898593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:05.898593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:05.898593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:05.899874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:05.978515 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:05.979017 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:38:05.979677 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:05.980148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:05.980953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:05.980953 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:05.980953 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:05.980953 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:05.980953 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:05.980953 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:05.980953 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:05.980953 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:05.982245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:05.982245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:05.982245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:05.982245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:05.982245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:05.982245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:05.982245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:05.982245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:05.982245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:05.982245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:05.982245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:05.982245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:05.982245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:05.982245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:05.982245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:05.982245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:05.983110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:05.983110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:05.983110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:05.983110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:05.983110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:05.983110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:05.983110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:05.983110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:05.983739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:05.983739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:05.983739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:05.983739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:05.983739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:05.983739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:05.983739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:05.983739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:05.983739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:05.983739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:05.983739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:05.983739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:05.983739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:05.983739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:38:05.983739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:38:05.983739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:05.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:05.985298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:05.985298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:05.985298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:06.213733 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:06.214604 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:06.215522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:06.216079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:06.217095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:06.217095 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:06.217095 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:06.217095 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:06.217095 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:06.217095 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:06.217095 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:06.217095 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:06.218527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:06.218527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:06.218527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:06.218527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:06.218527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:06.218527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:06.218527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:06.218527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:06.218527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:06.218527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:06.218527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:06.218527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:06.218527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:06.218527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:06.218527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:06.218527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:06.219404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:06.219404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:06.219404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:06.219404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:06.219404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:06.219404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:06.219404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:06.219404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:06.220164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:06.220164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:06.220164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:06.220164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:06.220164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:06.220164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:06.220164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:06.220164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:06.220164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:06.220164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:06.220164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:06.220164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:06.220164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:06.220164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:38:06.220164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:38:06.220164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:06.221079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:06.222023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:06.222023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:06.253851 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:06.254481 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:06.255241 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:06.255713 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:06.256476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:06.256820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:06.256820 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:06.256820 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:06.256820 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:06.256820 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:06.256820 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:06.256820 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:06.256820 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:06.258699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:06.258699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:06.258699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:06.258699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:06.258699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:06.258699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:06.258699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:06.258699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:06.258699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:06.258699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:06.258699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:06.258699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:06.258699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:06.258699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:38:06.258699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:06.258699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:06.258699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:06.259668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:10.824438 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:10.826179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:10.827900 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=259 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:38:10.861761 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:10.862254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:10.863179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:38:10.863179 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:10.863179 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:10.863179 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:10.863179 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:10.863179 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:10.863179 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:10.863179 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:10.864512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:10.864512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:10.864512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:10.864512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:10.864512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:10.864512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:10.864512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:10.864512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:10.864512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:10.864512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:10.864512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:10.864512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:10.864512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:10.864512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:38:10.864512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:10.864512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:10.864512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:10.865687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:10.895031 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:10.896420 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:10.896764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:10.897731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:10.897731 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:10.897731 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:10.897731 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:10.897731 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:10.897731 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:10.897731 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:10.897731 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:10.899535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:10.899535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:10.899535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:10.899535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:10.899535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:10.899535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:10.899535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:10.899535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:10.899535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:10.899535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:10.899535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:10.899535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:10.899535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:10.899535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:38:10.899535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:10.899535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:10.899535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:10.900305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:10.979428 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:10.979775 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:38:10.980351 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:10.980590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:10.981105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:10.981105 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:10.981105 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:10.981105 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:10.981105 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:10.981105 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:10.981105 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:10.981105 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:10.981716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:10.981716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:10.981716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:10.981716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:10.981716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:10.981716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:10.981716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:10.981716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:10.981716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:10.981716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:10.981716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:10.981716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:10.981716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:10.981716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:10.981716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:10.981716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:10.982452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:10.982452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:10.982452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:10.982452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:10.982452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:10.982452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:10.982452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:10.982452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:10.982452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:10.982452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:10.982452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:10.982452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:10.982452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:10.982452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:10.982452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:10.982452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:10.983180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:10.984120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:10.984120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:10.984120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:10.984120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:10.984120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:10.984120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:10.984120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:10.984120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:10.984120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:10.984120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:10.984120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:11.214707 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:11.215372 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:11.216136 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:11.216462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:11.217125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:11.217125 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:11.217125 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:11.217125 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:11.217125 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:11.217125 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:11.217125 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:11.217125 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:11.218457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:11.218457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:11.218457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:11.218457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:11.218457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:11.218457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:11.218457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:11.218457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:11.218457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:11.218457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:11.218457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:11.218457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:11.218457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:11.218457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:11.218457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:11.218457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:11.219166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:11.219166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:11.219166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:11.219166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:11.219166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:11.219166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:11.219166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:11.219166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:11.220063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:11.220063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:11.220063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:11.220063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:11.220063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:11.220063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:11.220063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:11.220063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:11.220063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:11.220063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:11.220063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:11.220063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:11.220063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:11.220063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:38:11.220063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:38:11.220063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:11.220780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:11.221777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:11.221777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:11.254447 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:11.254901 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:11.255620 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:11.256126 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:11.256406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:11.257372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:11.257372 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:11.257372 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:11.257372 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:11.257372 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:11.257372 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:11.257372 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:11.257372 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:11.259116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:11.259116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:11.259116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:11.259116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:11.259116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:11.259116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:11.259116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:11.259116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:11.259116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:11.259116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:11.259116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:11.259116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:11.259116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:11.259116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:38:11.259116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:11.259116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:11.259116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:11.260181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:15.825192 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:15.827111 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:15.857857 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:15.858329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:15.859206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:38:15.859206 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:15.859206 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:15.859206 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:15.859206 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:15.859206 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:15.859206 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:15.859206 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:15.860353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:15.860353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:15.860353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:15.860353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:15.860353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:15.860353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:15.860353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:15.860353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:15.860353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:15.860353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:15.860353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:15.860353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:15.860353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:15.860353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:38:15.860353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:15.860353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:15.860353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:15.861586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:15.895684 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:15.896750 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:15.897163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:15.897980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:15.897980 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:15.897980 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:15.897980 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:15.897980 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:15.897980 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:15.897980 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:15.897980 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:15.899746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:15.899746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:15.899746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:15.899746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:15.899746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:15.899746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:15.899746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:15.899746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:15.899746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:15.899746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:15.899746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:15.899746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:15.899746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:15.899746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:38:15.899746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:15.899746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:15.899746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:15.900808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:15.979964 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:15.980571 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:38:15.981454 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:15.981860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:15.982768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:15.982768 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:15.982768 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:15.982768 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:15.982768 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:15.982768 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:15.982768 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:15.982768 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:15.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:15.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:15.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:15.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:15.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:15.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:15.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:15.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:15.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:15.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:15.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:15.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:15.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:15.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:15.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:15.984445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:15.985243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:15.985243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:15.985243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:15.985243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:15.985243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:15.985243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:15.985243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:15.985243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:15.985841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:15.985841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:15.985841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:15.985841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:15.985841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:15.985841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:15.985841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:15.985841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:15.985841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:15.985841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:15.985841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:15.985841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:15.985841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:15.985841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:38:15.985841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:38:15.985841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:15.986579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:15.987398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:15.987398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:15.987398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:16.215418 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:16.216341 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:16.217463 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:16.217937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:16.218964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:16.218964 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:16.218964 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:16.218964 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:16.218964 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:16.218964 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:16.218964 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:16.218964 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:16.220608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:16.220608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:16.220608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:16.220608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:16.220608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:16.220608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:16.220608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:16.220608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:16.220608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:16.220608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:16.220608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:16.220608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:16.220608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:16.220608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:16.220608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:16.220608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:16.221745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:16.221745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:16.221745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:16.221745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:16.221745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:16.221745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:16.221745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:16.221745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:16.222331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:16.222331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:16.222331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:16.222331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:16.222331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:16.222331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:16.222331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:16.222331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:16.222331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:16.222331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:16.222331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:16.222331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:16.222331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:16.222331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:38:16.222331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:38:16.222331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:16.223182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:16.224162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:16.224162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:16.255033 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:16.255524 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:16.256200 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:16.256689 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:16.256902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:16.257859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:16.257859 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:16.257859 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:16.257859 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:16.257859 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:16.257859 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:16.257859 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:16.257859 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:16.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:16.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:16.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:16.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:16.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:16.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:16.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:16.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:16.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:16.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:16.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:16.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:16.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:16.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:38:16.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:16.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:16.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:16.260295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:20.826233 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:20.828136 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:20.862346 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:20.862799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:20.863801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:38:20.863801 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:20.863801 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:20.863801 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:20.863801 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:20.863801 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:20.863801 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:20.863801 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:20.865183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:20.865183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:20.865183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:20.865183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:20.865183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:20.865183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:20.865183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:20.865183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:20.865183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:20.865183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:20.865183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:20.865183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:20.865183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:20.865183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:38:20.865183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:20.865183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:20.865183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:20.866311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:20.896397 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:20.897700 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:20.898111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:20.899292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:20.899292 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:20.899292 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:20.899292 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:20.899292 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:20.899292 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:20.899292 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:20.899292 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:20.901301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:20.901301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:20.901301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:20.901301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:20.901301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:20.901301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:20.901301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:20.901301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:20.901301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:20.901301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:20.901301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:20.901301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:20.901301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:20.901301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:38:20.901301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:20.901301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:20.901301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:20.902176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:20.980668 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:20.981297 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:38:20.982011 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:20.982583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:20.983249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:20.983249 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:20.983249 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:20.983249 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:20.983249 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:20.983249 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:20.983249 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:20.983249 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:20.984580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:20.984580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:20.984580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:20.984580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:20.984580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:20.984580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:20.984580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:20.984580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:20.984580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:20.984580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:20.984580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:20.984580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:20.984580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:20.984580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:20.984580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:20.984580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:20.985783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:20.985783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:20.985783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:20.985783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:20.985783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:20.985783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:20.985783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:20.985783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:20.986317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:20.986317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:20.986317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:20.986317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:20.986317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:20.986317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:20.986317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:20.986317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:20.986317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:20.986317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:20.986317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:20.986317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:20.986317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:20.986317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:38:20.986317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:38:20.986317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:20.987040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:20.988832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:20.988832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:20.988832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:21.216394 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:21.217144 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:21.217846 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:21.218334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:21.219275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:21.219275 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:21.219275 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:21.219275 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:21.219275 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:21.219275 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:21.219275 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:21.219275 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:21.220440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:21.220440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:21.220440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:21.220440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:21.220440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:21.220440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:21.220440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:21.220440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:21.220440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:21.220440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:21.220440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:21.220440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:21.220440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:21.220440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:21.220440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:21.220440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:21.221239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:21.221239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:21.221239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:21.221239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:21.221239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:21.221239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:21.221239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:21.221239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:21.222021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:21.222021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:21.222021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:21.222021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:21.222021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:21.222021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:21.222021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:21.222021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:21.222021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:21.222021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:21.222021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:21.222021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:21.222021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:21.222021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:38:21.222021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:38:21.222021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:21.222798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:21.223568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:21.223568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:21.255865 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:21.256830 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:21.257533 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:21.257925 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:21.258146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:21.259051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:21.259051 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:21.259051 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:21.259051 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:21.259051 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:21.259051 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:21.259051 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:21.259051 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:21.261070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:21.261070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:21.261070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:21.261070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:21.261070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:21.261070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:21.261070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:21.261070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:21.261070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:21.261070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:21.261070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:21.261070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:21.261070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:21.261070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:38:21.261070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:21.261070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:21.261070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:21.262087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:25.827452 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:25.829399 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:25.865970 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:25.866441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:25.867579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:38:25.867579 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:25.867579 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:25.867579 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:25.867579 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:25.867579 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:25.867579 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:25.867579 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:25.868737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:25.868737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:25.868737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:25.868737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:25.868737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:25.868737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:25.868737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:25.868737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:25.868737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:25.868737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:25.868737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:25.868737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:25.868737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:25.868737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:38:25.868737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:25.868737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:25.868737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:25.869557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:25.897306 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:25.898766 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:25.899350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:25.900358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:25.900358 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:25.900358 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:25.900358 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:25.900358 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:25.900358 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:25.900358 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:25.900358 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:25.902278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:25.902278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:25.902278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:25.902278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:25.902278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:25.902278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:25.902278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:25.902278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:25.902278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:25.902278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:25.902278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:25.902278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:25.902278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:25.902278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:38:25.902278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:25.902278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:25.902278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:25.903429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:25.981380 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:25.982086 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:38:25.983467 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:25.984415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:25.985615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:25.985615 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:25.985615 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:25.985615 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:25.985615 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:25.985615 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:25.985615 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:25.985615 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:25.987106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:25.987106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:25.987106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:25.987106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:25.987106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:25.987106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:25.987106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:25.987106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:25.987106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:25.987106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:25.987106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:25.987106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:25.987106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:25.987106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:25.987106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:25.987106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:25.988006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:25.988006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:25.988006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:25.988006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:25.988006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:25.988006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:25.988006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:25.988006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:25.988739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:25.988739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:25.988739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:25.988739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:25.988739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:25.988739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:25.988739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:25.988739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:25.988739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:25.988739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:25.988739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:25.988739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:25.988739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:25.988739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:38:25.988739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:38:25.988739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:25.989490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:25.990347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:25.990347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:25.990347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:26.217412 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:26.218162 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:26.219973 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:26.220829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:26.222046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:26.222046 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:26.222046 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:26.222046 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:26.222046 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:26.222046 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:26.222046 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:26.222046 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:26.223544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:26.223544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:26.223544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:26.223544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:26.223544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:26.223544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:26.223544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:26.223544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:26.223544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:26.223544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:26.223544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:26.223544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:26.223544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:26.223544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:26.223544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:26.223544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:26.224323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:26.224323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:26.224323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:26.224323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:26.224323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:26.224323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:26.224323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:26.224323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:26.225265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:26.225265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:26.225265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:26.225265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:26.225265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:26.225265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:26.225265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:26.225265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:26.225265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:26.225265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:26.225265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:26.225265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:26.225265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:26.225265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:38:26.225265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:38:26.225265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:26.226073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:26.226891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:26.226891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:26.256560 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:26.257039 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:26.257691 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:26.257942 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:26.258122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:26.258854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:26.258854 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:26.258854 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:26.258854 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:26.258854 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:26.258854 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:26.258854 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:26.258854 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:26.260410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:26.260410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:26.260410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:26.260410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:26.260410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:26.260410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:26.260410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:26.260410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:26.260410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:26.260410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:26.260410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:26.260410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:26.260410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:26.260410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:38:26.260410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:26.260410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:26.260410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:26.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:30.828288 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:30.830351 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:30.866580 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:30.867005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:30.868010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:38:30.868010 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:30.868010 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:30.868010 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:30.868010 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:30.868010 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:30.868010 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:30.868010 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:30.869012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:30.869012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:30.869012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:30.869012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:30.869012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:30.869012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:30.869012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:30.869012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:30.869012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:30.869012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:30.869012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:30.869012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:30.869012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:30.869012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:38:30.869012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:30.869012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:30.869012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:30.869820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:30.898046 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:30.899381 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:30.899803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:30.900878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:30.900878 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:30.900878 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:30.900878 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:30.900878 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:30.900878 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:30.900878 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:30.900878 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:30.902720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:30.902720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:30.902720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:30.902720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:30.902720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:30.902720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:30.902720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:30.902720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:30.902720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:30.902720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:30.902720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:30.902720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:30.902720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:30.902720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:38:30.902720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:30.902720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:30.902720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:30.903785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:30.981908 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:30.982333 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:38:30.983018 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:30.983380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:30.984250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:30.984250 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:30.984250 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:30.984250 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:30.984250 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:30.984250 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:30.984250 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:30.984250 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:30.985677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:30.985677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:30.985677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:30.985677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:30.985677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:30.985677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:30.985677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:30.985677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:30.985677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:30.985677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:30.985677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:30.985677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:30.985677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:30.985677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:30.985677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:30.985677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:30.986518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:30.986518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:30.986518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:30.986518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:30.986518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:30.986518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:30.986518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:30.986518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:30.987208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:30.987208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:30.987208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:30.987208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:30.987208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:30.987208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:30.987208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:30.987208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:30.987208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:30.987208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:30.987208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:30.987208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:30.987208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:30.987208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:38:30.987208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:38:30.987208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:30.987935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:30.988847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:30.988847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:30.988847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:31.218371 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:31.218767 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:31.219680 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:31.220180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:31.221058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:31.221058 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:31.221058 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:31.221058 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:31.221058 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:31.221058 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:31.221058 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:31.221058 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:31.222388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:31.222388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:31.222388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:31.222388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:31.222388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:31.222388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:31.222388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:31.222388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:31.222388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:31.222388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:31.222388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:31.222388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:31.222388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:31.222388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:31.222388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:31.222388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:31.223252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:31.223252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:31.223252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:31.223252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:31.223252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:31.223252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:31.223252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:31.223252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:31.223942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:31.223942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:31.223942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:31.223942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:31.223942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:31.223942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:31.223942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:31.223942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:31.223942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:31.223942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:31.223942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:31.223942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:31.223942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:31.223942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:38:31.223942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:38:31.223942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:31.224677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:31.225193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:31.225193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:31.256964 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:31.257349 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:31.257890 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:31.258277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:31.258467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:31.259349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:31.259349 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:31.259349 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:31.259349 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:31.259349 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:31.259349 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:31.259349 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:31.259349 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:31.260498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:31.260498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:31.260498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:31.260498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:31.260498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:31.260498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:31.260498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:31.260498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:31.260498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:31.260498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:31.260498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:31.260498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:31.260498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:31.260498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:38:31.260498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:31.260498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:31.260498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:31.261269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:35.829180 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:35.830896 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:35.865141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:35.865613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:35.866633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:38:35.866633 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:35.866633 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:35.866633 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:35.866633 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:35.866633 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:35.866633 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:35.866633 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:35.867883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:35.867883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:35.867883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:35.867883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:35.867883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:35.867883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:35.867883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:35.867883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:35.867883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:35.867883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:35.867883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:35.867883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:35.867883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:35.867883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:38:35.867883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:35.867883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:35.867883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:35.868829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:35.898734 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:35.900169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:35.900459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:35.901368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:35.901368 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:35.901368 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:35.901368 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:35.901368 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:35.901368 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:35.901368 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:35.901368 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:35.903202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:35.903202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:35.903202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:35.903202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:35.903202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:35.903202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:35.903202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:35.903202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:35.903202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:35.903202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:35.903202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:35.903202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:35.903202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:35.903202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:38:35.903202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:35.903202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:35.903202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:35.904144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:35.982453 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:35.982958 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:38:35.983853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:35.984310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:35.985295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:35.985295 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:35.985295 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:35.985295 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:35.985295 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:35.985295 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:35.985295 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:35.985295 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:35.986621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:35.986621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:35.986621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:35.986621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:35.986621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:35.986621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:35.986621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:35.986621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:35.986621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:35.986621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:35.986621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:35.986621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:35.986621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:35.986621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:35.986621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:35.986621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:35.987517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:35.987517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:35.987517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:35.987517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:35.987517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:35.987517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:35.987517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:35.987517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:35.988193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:35.988193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:35.988193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:35.988193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:35.988193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:35.988193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:35.988193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:35.988193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:35.988193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:35.988193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:35.988193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:35.988193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:35.988193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:35.988193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:38:35.988193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:38:35.988193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:35.989071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:35.989882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:35.989882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:35.989882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:36.219274 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:36.219799 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:36.220941 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:36.221405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:36.222417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:36.222417 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:36.222417 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:36.222417 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:36.222417 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:36.222417 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:36.222417 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:36.222417 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:36.223724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:36.223724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:36.223724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:36.223724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:36.223724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:36.223724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:36.223724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:36.223724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:36.223724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:36.223724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:36.223724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:36.223724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:36.223724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:36.223724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:36.223724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:36.223724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:36.224410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:36.224410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:36.224410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:36.224410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:36.224410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:36.224410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:36.224410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:36.224410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:36.225340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:36.225340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:36.225340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:36.225340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:36.225340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:36.225340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:36.225340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:36.225340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:36.225340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:36.225340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:36.225340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:36.225340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:36.225340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:36.225340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:38:36.225340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:38:36.225340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:36.226093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:36.226886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:36.226886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:36.257387 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:36.258104 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:36.258965 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:36.259503 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:36.259752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:36.260717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:36.260717 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:36.260717 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:36.260717 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:36.260717 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:36.260717 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:36.260717 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:36.260717 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:36.262571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:36.262571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:36.262571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:36.262571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:36.262571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:36.262571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:36.262571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:36.262571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:36.262571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:36.262571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:36.262571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:36.262571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:36.262571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:36.262571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:38:36.262571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:36.262571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:36.262571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:36.263351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:40.830022 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:40.831522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:40.865603 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:40.866087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:40.867010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:38:40.867010 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:40.867010 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:40.867010 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:40.867010 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:40.867010 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:40.867010 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:40.867010 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:40.868312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:40.868312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:40.868312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:40.868312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:40.868312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:40.868312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:40.868312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:40.868312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:40.868312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:40.868312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:40.868312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:40.868312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:40.868312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:40.868312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:38:40.868312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:40.868312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:40.868312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:40.869489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:40.899459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:40.900403 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:40.900682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:40.901444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:40.901444 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:40.901444 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:40.901444 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:40.901444 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:40.901444 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:40.901444 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:40.901444 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:40.903073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:40.903073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:40.903073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:40.903073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:40.903073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:40.903073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:40.903073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:40.903073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:40.903073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:40.903073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:40.903073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:40.903073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:40.903073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:40.903073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:38:40.903073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:40.903073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:40.903073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:40.903589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:40.983053 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:40.983793 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:38:40.984051 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:40.984301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:40.985053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:40.985053 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:40.985053 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:40.985053 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:40.985053 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:40.985053 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:40.985053 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:40.985053 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:40.986653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:40.986653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:40.986653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:40.986653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:40.986653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:40.986653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:40.986653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:40.986653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:40.986653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:40.986653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:40.986653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:40.986653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:40.986653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:40.986653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:40.986653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:40.986653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:40.987219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:40.987219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:40.987219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:40.987219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:40.987219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:40.987219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:40.987219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:40.987219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:40.988430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:40.988430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:40.988430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:40.988430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:40.988430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:40.988430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:40.988430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:40.988430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:40.988430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:40.988430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:40.988430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:40.988430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:40.988430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:40.988430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:38:40.988430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:38:40.988430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:40.988853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:40.989402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:40.989402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:40.989402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:41.220016 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:41.220362 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:41.221016 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:41.221551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:41.222590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:41.222590 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:41.222590 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:41.222590 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:41.222590 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:41.222590 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:41.222590 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:41.222590 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:41.223773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:41.223773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:41.223773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:41.223773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:41.223773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:41.223773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:41.223773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:41.223773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:41.223773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:41.223773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:41.223773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:41.223773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:41.223773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:41.223773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:41.223773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:41.223773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:41.224572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:41.224572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:41.224572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:41.224572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:41.224572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:41.224572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:41.224572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:41.224572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:41.225420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:41.225420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:41.225420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:41.225420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:41.225420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:41.225420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:41.225420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:41.225420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:41.225420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:41.225420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:41.225420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:41.225420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:41.225420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:41.225420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:38:41.225420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:38:41.225420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:41.226215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:41.227113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:41.227113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:41.257754 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:41.258365 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:41.259323 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:41.259750 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:41.259953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:41.260883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:41.260883 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:41.260883 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:41.260883 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:41.260883 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:41.260883 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:41.260883 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:41.260883 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:41.262735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:41.262735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:41.262735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:41.262735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:41.262735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:41.262735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:41.262735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:41.262735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:41.262735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:41.262735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:41.262735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:41.262735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:41.262735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:41.262735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:38:41.262735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:41.262735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:41.262735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:41.263704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:45.830741 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:45.832357 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:45.861734 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:45.862108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:45.862810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:38:45.862810 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:45.862810 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:45.862810 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:45.862810 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:45.862810 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:45.862810 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:45.862810 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:45.863575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:45.863575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:45.863575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:45.863575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:45.863575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:45.863575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:45.863575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:45.863575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:45.863575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:45.863575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:45.863575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:45.863575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:45.863575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:45.863575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:38:45.863575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:45.863575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:45.863575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:45.864804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:45.899972 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:45.900780 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:45.901093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:45.901753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:45.901753 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:45.901753 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:45.901753 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:45.901753 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:45.901753 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:45.901753 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:45.901753 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:45.903293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:45.903293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:45.903293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:45.903293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:45.903293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:45.903293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:45.903293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:45.903293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:45.903293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:45.903293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:45.903293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:45.903293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:45.903293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:45.903293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:38:45.903293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:45.903293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:45.903293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:45.904365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:45.983682 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:45.984109 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:38:45.984775 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:45.985126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:45.985904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:45.985904 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:45.985904 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:45.985904 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:45.985904 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:45.985904 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:45.985904 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:45.985904 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:45.987136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:45.987136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:45.987136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:45.987136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:45.987136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:45.987136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:45.987136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:45.987136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:45.987136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:45.987136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:45.987136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:45.987136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:45.987136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:45.987136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:45.987136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:45.987136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:45.988014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:45.988014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:45.988014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:45.988014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:45.988014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:45.988014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:45.988014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:45.988014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:45.988620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:45.988620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:45.988620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:45.988620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:45.988620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:45.988620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:45.988620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:45.988620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:45.988620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:45.988620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:45.988620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:45.988620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:45.988620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:45.988620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:38:45.988620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:38:45.988620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:45.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:45.990433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:45.990433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:45.990433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:46.220612 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:46.220934 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:46.221841 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:46.222348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:46.223283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:46.223283 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:46.223283 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:46.223283 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:46.223283 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:46.223283 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:46.223283 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:46.223283 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:46.224521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:46.224521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:46.224521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:46.224521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:46.224521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:46.224521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:46.224521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:46.224521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:46.224521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:46.224521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:46.224521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:46.224521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:46.224521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:46.224521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:46.224521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:46.224521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:46.225305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:46.225305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:46.225305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:46.225305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:46.225305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:46.225305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:46.225305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:46.225305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:46.226281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:46.226281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:46.226281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:46.226281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:46.226281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:46.226281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:46.226281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:46.226281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:46.226281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:46.226281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:46.226281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:46.226281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:46.226281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:46.226281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:38:46.226281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:38:46.226281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:46.227131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:46.228031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:46.228031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:46.258230 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:46.258859 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:46.259393 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:46.259724 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:46.259910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:46.260637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:46.260637 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:46.260637 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:46.260637 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:46.260637 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:46.260637 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:46.260637 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:46.260637 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:46.262397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:46.262397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:46.262397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:46.262397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:46.262397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:46.262397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:46.262397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:46.262397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:46.262397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:46.262397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:46.262397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:46.262397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:46.262397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:46.262397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:38:46.262397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:46.262397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:46.262397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:46.263223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:50.831385 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:50.832596 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:50.862996 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:50.863500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:50.864591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:38:50.864591 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:50.864591 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:50.864591 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:50.864591 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:50.864591 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:50.864591 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:50.864591 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:50.865616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:50.865616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:50.865616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:50.865616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:50.865616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:50.865616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:50.865616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:50.865616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:50.865616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:50.865616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:50.865616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:50.865616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:50.865616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:50.865616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:38:50.865616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:50.865616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:50.865616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:50.866136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:50.900494 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:50.901973 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:50.902488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:50.903608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:50.903608 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:50.903608 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:50.903608 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:50.903608 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:50.903608 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:50.903608 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:50.903608 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:50.905614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:50.905614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:50.905614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:50.905614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:50.905614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:50.905614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:50.905614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:50.905614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:50.905614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:50.905614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:50.905614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:50.905614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:50.905614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:50.905614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:38:50.905614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:50.905614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:50.905614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:50.906085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:50.984410 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:50.984842 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:38:50.986132 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:50.987122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:50.988227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:50.988227 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:50.988227 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:50.988227 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:50.988227 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:50.988227 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:50.988227 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:50.988227 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:50.989564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:50.989564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:50.989564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:50.989564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:50.989564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:50.989564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:50.989564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:50.989564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:50.989564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:50.989564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:50.989564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:50.989564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:50.989564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:50.989564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:50.989564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:50.989564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:50.990389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:50.990389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:50.990389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:50.990389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:50.990389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:50.990389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:50.990389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:50.990389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:50.991437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:50.991437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:50.991437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:50.991437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:50.991437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:50.991437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:50.991437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:50.991437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:50.991437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:50.991437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:50.991437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:50.991437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:50.991437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:50.991437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:38:50.991437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:38:50.991437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:50.992643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:50.993420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:50.993420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:50.993420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:51.221358 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:51.222026 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:51.222936 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:51.223394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:51.224436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:51.224436 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:51.224436 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:51.224436 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:51.224436 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:51.224436 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:51.224436 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:51.224436 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:51.225824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:51.225824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:51.225824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:51.225824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:51.225824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:51.225824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:51.225824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:51.225824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:51.225824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:51.225824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:51.225824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:51.225824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:51.225824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:51.225824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:51.225824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:51.225824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:51.226562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:51.226562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:51.226562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:51.226562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:51.226562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:51.226562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:51.226562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:51.226562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:51.227683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:51.227683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:51.227683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:51.227683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:51.227683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:51.227683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:51.227683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:51.227683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:51.227683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:51.227683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:51.227683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:51.227683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:51.227683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:51.227683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:38:51.227683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:38:51.227683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:51.228494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:51.229278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:51.229278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:51.258897 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:51.259401 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:51.259901 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:51.260288 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:51.260482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:51.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:51.261209 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:51.261209 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:51.261209 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:51.261209 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:51.261209 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:51.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:51.261209 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:51.262762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:51.262762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:51.262762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:51.262762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:51.262762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:51.262762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:51.262762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:51.262762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:51.262762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:51.262762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:51.262762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:51.262762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:51.262762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:51.262762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:38:51.262762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:51.262762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:51.262762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:51.263580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:55.832102 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:55.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:55.869735 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:55.870114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:55.871013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:38:55.871013 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:55.871013 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:55.871013 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:55.871013 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:55.871013 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:55.871013 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:55.871013 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:55.872389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:55.872389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:55.872389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:55.872389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:55.872389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:55.872389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:55.872389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:55.872389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:55.872389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:55.872389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:55.872389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:55.872389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:55.872389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:55.872389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:38:55.872389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:55.872389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:55.872389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:55.873262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:55.901311 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:55.902676 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:55.903007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:55.903924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:55.903924 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:55.903924 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:55.903924 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:55.903924 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:55.903924 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:55.903924 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:55.903924 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:55.905738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:55.905738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:55.905738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:55.905738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:55.905738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:55.905738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:55.905738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:55.905738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:55.905738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:55.905738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:55.905738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:55.905738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:55.905738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:55.905738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:38:55.905738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:55.905738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:55.905738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:55.906587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:55.985063 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:55.985605 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:38:55.986331 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:55.986744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:55.987587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:55.987587 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:55.987587 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:55.987587 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:55.987587 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:55.987587 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:55.987587 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:55.987587 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:55.989006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:55.989006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:55.989006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:55.989006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:55.989006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:55.989006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:55.989006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:55.989006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:55.989006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:55.989006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:55.989006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:55.989006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:55.989006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:55.989006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:55.989006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:55.989006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:55.989547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:55.989547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:55.989547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:55.989547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:55.989547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:55.989547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:55.989547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:55.989547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:55.990930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:55.990930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:55.990930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:55.990930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:55.990930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:55.990930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:55.990930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:55.990930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:55.990930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:55.990930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:55.990930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:55.990930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:55.990930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:55.990930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:38:55.990930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:38:55.990930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:55.991430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:55.992036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:55.992036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:55.992036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:56.222073 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:56.222760 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:56.223751 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:56.224217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:56.225204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:56.225204 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:56.225204 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:56.225204 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:56.225204 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:56.225204 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:56.225204 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:56.225204 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:56.226462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:56.226462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:38:56.226462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:56.226462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:56.226462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:56.226462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:56.226462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:56.226462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:56.226462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:56.226462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:38:56.226462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:56.226462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:38:56.226462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:56.226462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:38:56.226462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:38:56.226462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:56.228170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:38:56.228170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:56.228170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:38:56.228170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:38:56.228170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:56.228170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:38:56.228170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:56.228170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:38:56.228170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:56.228170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:56.228170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:56.228170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:56.228170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:56.228170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:56.228170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:56.228170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:56.228862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:56.229731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:56.229731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:56.229731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:56.229731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:56.229731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:56.229731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:56.229731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:56.229731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:56.229731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:38:56.259473 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:38:56.260179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:38:56.260854 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:56.261242 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:38:56.261434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:56.262145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:38:56.262145 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:56.262145 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:38:56.262145 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:38:56.262145 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:56.262145 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:38:56.262145 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:56.262145 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:38:56.263802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:56.263802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:38:56.263802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:38:56.263802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:38:56.263802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:38:56.263802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:38:56.263802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:56.263802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:38:56.263802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:38:56.263802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:38:56.263802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:38:56.263802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:38:56.263802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:38:56.263802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:38:56.263802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:38:56.263802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:56.263802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:38:56.264571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:00.832801 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:00.834304 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:00.869276 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:00.914954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:00.914954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:39:00.914954 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:00.914954 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:00.914954 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:00.914954 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:00.914954 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:00.914954 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:00.914954 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:00.914954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:00.914954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:00.914954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:00.914954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:00.914954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:00.914954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:00.914954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:00.914954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:00.915891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:00.916807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:00.916807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:00.916807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:00.916807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:00.916807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:00.916807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:00.916807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:00.916807 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:00.916807 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:00.916807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:00.916807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:00.916807 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:00.916807 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:00.916807 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:00.917480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:00.918288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:00.919133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:00.919133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:00.985573 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:00.986009 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:39:00.986620 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:00.987007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:00.987903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:00.987903 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:00.987903 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:00.987903 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:00.987903 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:00.987903 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:00.987903 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:00.987903 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:00.989286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:00.989286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:00.989286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:00.989286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:00.989286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:00.989286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:00.989286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:00.989286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:00.989286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:00.989286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:00.989286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:00.989286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:00.989286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:00.989286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:00.989286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:00.989286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:00.990091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:00.990091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:00.990091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:00.990091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:00.990091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:00.990091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:00.990091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:00.990091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:00.990929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:00.990929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:00.990929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:00.990929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:00.990929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:00.990929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:00.990929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:00.990929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:00.990929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:00.990929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:00.990929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:00.990929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:00.990929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:00.990929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:39:00.990929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:39:00.990929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:00.991716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:00.992704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:00.992704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:00.992704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:01.222749 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:01.223356 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:01.224215 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:01.224669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:01.225570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:01.225570 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:01.225570 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:01.225570 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:01.225570 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:01.225570 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:01.225570 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:01.225570 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:01.226838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:01.226838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:01.226838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:01.226838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:01.226838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:01.226838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:01.226838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:01.226838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:01.226838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:01.226838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:01.226838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:01.226838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:01.226838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:01.226838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:01.226838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:01.226838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:01.227655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:01.227655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:01.227655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:01.227655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:01.227655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:01.227655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:01.227655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:01.227655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:01.228446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:01.228446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:01.228446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:01.228446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:01.228446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:01.228446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:01.228446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:01.228446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:01.228446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:01.228446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:01.228446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:01.228446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:01.228446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:01.228446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:39:01.228446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:39:01.228446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:01.229225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:01.230050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:01.230050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:01.259900 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:01.260308 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:01.261012 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:01.261472 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:01.261679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:01.262576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:01.262576 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:01.262576 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:01.262576 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:01.262576 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:01.262576 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:01.262576 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:01.262576 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:01.264176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:01.264176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:01.264176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:01.264176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:01.264176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:01.264176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:01.264176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:01.264176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:01.264176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:01.264176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:01.264176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:01.264176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:01.264176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:01.264176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:39:01.264176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:01.264176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:01.264176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:01.264935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:05.833518 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:05.835041 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:05.863972 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:05.864325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:05.865050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:39:05.865050 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:05.865050 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:05.865050 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:05.865050 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:05.865050 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:05.865050 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:05.865050 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:05.866057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:05.866057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:05.866057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:05.866057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:05.866057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:05.866057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:05.866057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:05.866057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:05.866057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:05.866057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:05.866057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:05.866057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:05.866057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:05.866057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:39:05.866057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:05.866057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:05.866057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:05.866968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:05.902339 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:05.903317 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:05.903830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:05.904646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:05.904646 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:05.904646 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:05.904646 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:05.904646 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:05.904646 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:05.904646 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:05.904646 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:05.906440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:05.906440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:05.906440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:05.906440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:05.906440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:05.906440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:05.906440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:05.906440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:05.906440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:05.906440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:05.906440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:05.906440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:05.906440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:05.906440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:39:05.906440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:05.906440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:05.906440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:05.907299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:05.986117 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:05.986714 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:39:05.987342 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:05.987686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:05.988432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:05.988432 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:05.988432 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:05.988432 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:05.988432 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:05.988432 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:05.988432 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:05.988432 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:05.989713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:05.989713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:05.989713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:05.989713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:05.989713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:05.989713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:05.989713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:05.989713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:05.989713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:05.989713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:05.989713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:05.989713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:05.989713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:05.989713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:05.989713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:05.989713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:05.990571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:05.990571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:05.990571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:05.990571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:05.990571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:05.990571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:05.990571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:05.990571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:05.991277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:05.991277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:05.991277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:05.991277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:05.991277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:05.991277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:05.991277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:05.991277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:05.991277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:05.991277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:05.991277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:05.991277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:05.991277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:05.991277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:39:05.991277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:39:05.991277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:05.992240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:05.993643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:05.993643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:05.993643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:06.223499 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:06.224220 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:06.224997 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:06.225516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:06.226393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:06.226393 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:06.226393 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:06.226393 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:06.226393 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:06.226393 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:06.226393 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:06.226393 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:06.227696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:06.227696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:06.227696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:06.227696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:06.227696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:06.227696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:06.227696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:06.227696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:06.227696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:06.227696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:06.227696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:06.227696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:06.227696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:06.227696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:06.227696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:06.227696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:06.228485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:06.228485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:06.228485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:06.228485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:06.228485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:06.228485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:06.228485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:06.228485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:06.229364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:06.229364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:06.229364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:06.229364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:06.229364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:06.229364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:06.229364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:06.229364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:06.229364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:06.229364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:06.229364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:06.229364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:06.229364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:06.229364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:39:06.229364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:39:06.229364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:06.230240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:06.231075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:06.231075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:06.260332 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:06.260739 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:06.261283 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:06.261632 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:06.261831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:06.262559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:06.262559 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:06.262559 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:06.262559 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:06.262559 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:06.262559 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:06.262559 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:06.262559 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:06.264205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:06.264205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:06.264205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:06.264205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:06.264205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:06.264205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:06.264205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:06.264205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:06.264205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:06.264205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:06.264205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:06.264205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:06.264205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:06.264205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:39:06.264205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:06.264205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:06.264205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:06.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:10.834576 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:10.836257 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:10.838292 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=240 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:39:10.868765 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:10.869321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:10.870137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:39:10.870137 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:10.870137 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:10.870137 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:10.870137 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:10.870137 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:10.870137 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:10.870137 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:10.871002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:10.871002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:10.871002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:10.871002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:10.871002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:10.871002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:10.871002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:10.871002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:10.871002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:10.871002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:10.871002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:10.871002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:10.871002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:10.871002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:39:10.871002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:10.871002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:10.871002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:10.871978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:10.902931 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:10.904427 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:10.904787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:10.906056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:10.906056 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:10.906056 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:10.906056 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:10.906056 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:10.906056 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:10.906056 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:10.906056 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:10.908192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:10.908192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:10.908192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:10.908192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:10.908192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:10.908192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:10.908192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:10.908192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:10.908192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:10.908192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:10.908192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:10.908192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:10.908192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:10.908192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:39:10.908192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:10.908192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:10.908192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:10.908727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:10.987489 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:10.988149 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-92cafed4-ba6e-43f0-a08f-796ccf42fcee None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:39:10.989018 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:10.989364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:10.990322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-92cafed4-ba6e-43f0-a08f-796ccf42fcee None None] Traceback (most recent call last):
Apr 07 19:39:10.990322 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:10.990322 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:10.990322 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:10.990322 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:10.990322 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:10.990322 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:10.990322 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:10.991712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-92cafed4-ba6e-43f0-a08f-796ccf42fcee None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:10.991712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:10.991712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:10.991712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:10.991712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:10.991712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:10.991712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:10.991712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:10.991712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:10.991712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:10.991712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:10.991712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:10.991712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:10.991712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:10.991712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:10.992571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:10.992571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:10.992571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:10.992571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:10.992571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:10.992571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:10.992571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:10.992571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:10.992571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:10.993430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-92cafed4-ba6e-43f0-a08f-796ccf42fcee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:10.993430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:10.993430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:10.993430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:10.993430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:10.993430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:10.993430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:10.993430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:10.993430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:10.993430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:10.993430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:10.993430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:10.993430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:10.993430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:39:10.993430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:39:10.993430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:10.994204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:10.995013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:10.995013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:10.995013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:11.224761 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:11.225402 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:11.226125 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:11.226638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:11.227570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:11.227570 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:11.227570 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:11.227570 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:11.227570 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:11.227570 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:11.227570 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:11.227570 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:11.229029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:11.229029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:11.229029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:11.229029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:11.229029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:11.229029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:11.229029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:11.229029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:11.229029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:11.229029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:11.229029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:11.229029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:11.229029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:11.229029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:11.229029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:11.229029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:11.229759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:11.229759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:11.229759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:11.229759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:11.229759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:11.229759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:11.229759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:11.229759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:11.230660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:11.230660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:11.230660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:11.230660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:11.230660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:11.230660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:11.230660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:11.230660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:11.230660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:11.230660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:11.230660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:11.230660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:11.230660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:11.230660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:39:11.230660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:39:11.230660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:11.231447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:11.232293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:11.232293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:11.260925 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:11.261374 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:11.261820 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:11.262215 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:11.262398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:11.263169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:11.263169 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:11.263169 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:11.263169 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:11.263169 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:11.263169 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:11.263169 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:11.263169 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:11.264885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:11.264885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:11.264885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:11.264885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:11.264885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:11.264885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:11.264885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:11.264885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:11.264885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:11.264885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:11.264885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:11.264885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:11.264885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:11.264885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:39:11.264885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:11.264885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:11.264885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:11.265692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:15.835514 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:15.837791 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:15.902868 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:15.903239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:15.904591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:39:15.904591 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:15.904591 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:15.904591 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:15.904591 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:15.904591 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:15.904591 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:15.904591 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:15.906886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:15.906886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:15.906886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:15.906886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:15.906886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:15.906886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:15.906886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:15.906886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:15.906886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:15.906886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:15.906886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:15.906886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:15.906886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:15.906886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:39:15.906886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:15.906886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:15.906886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:15.907383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:15.907852 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:15.909331 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:15.909593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:15.910365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:39:15.910365 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:15.910365 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:15.910365 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:15.910365 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:15.910365 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:15.910365 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:15.910365 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:15.911396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:15.911396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:15.911396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:15.911396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:15.911396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:15.911396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:15.911396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:15.911396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:15.911396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:15.911396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:15.911396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:15.911396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:15.911396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:15.911396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:39:15.911396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:15.911396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:15.911918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:15.988152 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:15.988589 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:39:15.989200 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:15.989525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:15.990430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:39:15.990430 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:15.990430 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:15.990430 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:15.990430 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:15.990430 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:15.990430 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:15.990430 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:15.991722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:15.991722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:15.991722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:15.991722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:15.991722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:15.991722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:15.991722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:15.991722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:15.991722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:15.991722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:15.991722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:15.991722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:15.991722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:15.991722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:15.991722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:15.992427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:15.992427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:15.992427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:15.992427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:15.992427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:15.992427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:15.992427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:15.992427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:15.992427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:15.993261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:15.993261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:15.993261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:15.993261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:15.993261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:15.993261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:15.993261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:15.993261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:15.993261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:15.993261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:15.993261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:15.993261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:15.993261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:15.993261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:39:15.993261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:39:15.993261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:15.993972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:15.994769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:15.994769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:15.994769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:16.225828 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:16.226368 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:16.227253 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:16.227694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:16.228648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:16.228648 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:16.228648 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:16.228648 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:16.228648 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:16.228648 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:16.228648 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:16.228648 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:16.229921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:16.229921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:16.229921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:16.229921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:16.229921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:16.229921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:16.229921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:16.229921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:16.229921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:16.229921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:16.229921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:16.229921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:16.229921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:16.229921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:16.229921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:16.229921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:16.230736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:16.230736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:16.230736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:16.230736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:16.230736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:16.230736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:16.230736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:16.230736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:16.231635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:16.231635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:16.231635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:16.231635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:16.231635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:16.231635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:16.231635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:16.231635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:16.231635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:16.231635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:16.231635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:16.231635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:16.231635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:16.231635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:39:16.231635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:39:16.231635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:16.232453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:16.233321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:16.233321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:16.261619 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:16.262146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:16.262812 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:16.263224 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:16.263395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:16.264201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:16.264201 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:16.264201 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:16.264201 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:16.264201 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:16.264201 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:16.264201 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:16.264201 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:16.265870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:16.265870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:16.265870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:16.265870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:16.265870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:16.265870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:16.265870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:16.265870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:16.265870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:16.265870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:16.265870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:16.265870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:16.265870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:16.265870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:39:16.265870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:16.265870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:16.265870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:16.266742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:20.836531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:20.838405 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:20.872398 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:20.872976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:20.874169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:39:20.874169 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:20.874169 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:20.874169 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:20.874169 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:20.874169 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:20.874169 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:20.874169 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:20.875408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:20.875408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:20.875408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:20.875408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:20.875408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:20.875408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:20.875408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:20.875408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:20.875408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:20.875408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:20.875408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:20.875408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:20.875408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:20.875408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:39:20.875408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:20.875408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:20.875408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:20.876588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:20.907899 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:20.908939 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:20.909204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:20.909972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:20.909972 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:20.909972 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:20.909972 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:20.909972 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:20.909972 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:20.909972 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:20.909972 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:20.912288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:20.912288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:20.912288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:20.912288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:20.912288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:20.912288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:20.912288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:20.912288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:20.912288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:20.912288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:20.912288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:20.912288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:20.912288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:20.912288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:39:20.912288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:20.912288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:20.912288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:20.913447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:20.988952 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:20.989573 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:39:20.990307 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:20.990608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:20.991450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:39:20.991450 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:20.991450 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:20.991450 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:20.991450 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:20.991450 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:20.991450 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:20.991450 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:20.993064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:20.993064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:20.993064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:20.993064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:20.993064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:20.993064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:20.993064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:20.993064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:20.993064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:20.993064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:20.993064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:20.993064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:20.993064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:20.993064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:20.993064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:20.993769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:20.993769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:20.993769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:20.993769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:20.993769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:20.993769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:20.993769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:20.993769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:20.993769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:20.994272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:20.994272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:20.994272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:20.994272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:20.994272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:20.994272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:20.994272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:20.994272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:20.994272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:20.994272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:20.994272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:20.994272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:20.994272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:20.994272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:39:20.994272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:39:20.994272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:20.994943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:20.995716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:20.995716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:20.995716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:21.226717 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:21.227140 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:21.227972 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:21.228333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:21.229066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:21.229066 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:21.229066 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:21.229066 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:21.229066 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:21.229066 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:21.229066 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:21.229066 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:21.230395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:21.230395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:21.230395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:21.230395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:21.230395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:21.230395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:21.230395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:21.230395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:21.230395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:21.230395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:21.230395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:21.230395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:21.230395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:21.230395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:21.230395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:21.230395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:21.231050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:21.231050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:21.231050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:21.231050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:21.231050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:21.231050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:21.231050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:21.231050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:21.231924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:21.231924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:21.231924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:21.231924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:21.231924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:21.231924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:21.231924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:21.231924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:21.231924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:21.231924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:21.231924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:21.231924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:21.231924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:21.231924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:39:21.231924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:39:21.231924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:21.232531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:21.233206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:21.233206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:21.262341 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:21.262964 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:21.263620 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:21.264037 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:21.264360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:21.265176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:21.265176 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:21.265176 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:21.265176 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:21.265176 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:21.265176 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:21.265176 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:21.265176 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:21.267275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:21.267275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:21.267275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:21.267275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:21.267275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:21.267275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:21.267275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:21.267275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:21.267275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:21.267275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:21.267275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:21.267275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:21.267275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:21.267275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:39:21.267275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:21.267275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:21.267275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:21.268071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:25.837386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:25.838942 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:25.872674 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:25.873099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:25.873888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:39:25.873888 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:25.873888 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:25.873888 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:25.873888 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:25.873888 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:25.873888 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:25.873888 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:25.874797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:25.874797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:25.874797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:25.874797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:25.874797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:25.874797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:25.874797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:25.874797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:25.874797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:25.874797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:25.874797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:25.874797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:25.874797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:25.874797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:39:25.874797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:25.874797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:25.874797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:25.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:25.908366 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:25.909457 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:25.909699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:25.910430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:25.910430 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:25.910430 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:25.910430 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:25.910430 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:25.910430 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:25.910430 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:25.910430 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:25.912338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:25.912338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:25.912338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:25.912338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:25.912338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:25.912338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:25.912338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:25.912338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:25.912338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:25.912338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:25.912338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:25.912338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:25.912338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:25.912338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:39:25.912338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:25.912338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:25.912338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:25.913166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:25.989601 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:25.990161 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:39:25.990712 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:25.991082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:25.991876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:39:25.991876 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:25.991876 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:25.991876 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:25.991876 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:25.991876 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:25.991876 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:25.991876 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:25.993153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:25.993153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:25.993153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:25.993153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:25.993153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:25.993153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:25.993153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:25.993153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:25.993153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:25.993153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:25.993153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:25.993153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:25.993153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:25.993153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:25.993153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:25.993942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:25.993942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:25.993942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:25.993942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:25.993942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:25.993942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:25.993942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:25.993942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:25.993942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:25.994697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:25.994697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:25.994697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:25.994697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:25.994697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:25.994697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:25.994697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:25.994697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:25.994697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:25.994697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:25.994697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:25.994697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:25.994697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:25.994697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:39:25.994697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:39:25.994697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:25.995705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:25.996671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:25.996671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:25.996671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:26.227305 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:26.227836 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:26.228817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:26.229533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:26.230624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:26.230624 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:26.230624 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:26.230624 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:26.230624 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:26.230624 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:26.230624 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:26.230624 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:26.231565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:26.231565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:26.231565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:26.231565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:26.231565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:26.231565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:26.231565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:26.231565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:26.231565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:26.231565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:26.231565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:26.231565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:26.231565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:26.231565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:26.231565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:26.231565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:26.232475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:26.232475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:26.232475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:26.232475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:26.232475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:26.232475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:26.232475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:26.232475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:26.232853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:26.232853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:26.232853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:26.232853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:26.232853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:26.232853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:26.232853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:26.232853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:26.232853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:26.232853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:26.232853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:26.232853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:26.232853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:26.232853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:39:26.232853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:39:26.232853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:26.233835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:26.234685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:26.234685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:26.262958 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:26.263323 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:26.264028 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:26.264351 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:26.264471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:26.265155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:26.265155 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:26.265155 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:26.265155 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:26.265155 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:26.265155 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:26.265155 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:26.265155 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:26.269086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:26.269086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:26.269086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:26.269086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:26.269086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:26.269086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:26.269086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:26.269086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:26.269086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:26.269086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:26.269086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:26.269086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:26.269086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:26.269086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:39:26.269086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:26.269086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:26.269086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:26.269903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:30.841267 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:30.842730 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:30.871653 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:30.871653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:30.871852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:39:30.871852 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:30.871852 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:30.871852 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:30.871852 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:30.871852 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:30.871852 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:30.871852 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:30.872738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:30.872738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:30.872738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:30.872738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:30.872738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:30.872738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:30.872738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:30.872738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:30.872738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:30.872738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:30.872738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:30.872738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:30.872738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:30.872738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:39:30.872738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:30.872738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:30.872738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:30.873454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:30.909027 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:30.910303 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:30.910947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:30.911673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:30.911673 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:30.911673 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:30.911673 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:30.911673 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:30.911673 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:30.911673 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:30.911673 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:30.912817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:30.912817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:30.912817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:30.912817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:30.912817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:30.912817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:30.912817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:30.912817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:30.912817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:30.912817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:30.912817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:30.912817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:30.912817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:30.912817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:39:30.912817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:30.912817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:30.912817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:30.913698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:30.990260 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:30.990907 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:39:30.991469 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:30.991778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:30.992605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:39:30.992605 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:30.992605 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:30.992605 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:30.992605 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:30.992605 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:30.992605 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:30.992605 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:30.993818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:30.993818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:30.993818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:30.993818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:30.993818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:30.993818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:30.993818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:30.993818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:30.993818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:30.993818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:30.993818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:30.993818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:30.993818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:30.993818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:30.993818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:30.994669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:30.994669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:30.994669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:30.994669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:30.994669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:30.994669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:30.994669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:30.994669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:30.994669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:30.995449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:30.995449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:30.995449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:30.995449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:30.995449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:30.995449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:30.995449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:30.995449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:30.995449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:30.995449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:30.995449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:30.995449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:30.995449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:30.995449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:39:30.995449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:39:30.995449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:30.996238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:30.997100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:30.997100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:30.997100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:31.228026 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:31.228331 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:31.228943 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:31.229344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:31.230088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:31.230088 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:31.230088 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:31.230088 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:31.230088 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:31.230088 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:31.230088 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:31.230088 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:31.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:31.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:31.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:31.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:31.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:31.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:31.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:31.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:31.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:31.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:31.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:31.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:31.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:31.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:31.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:31.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:31.232154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:31.232154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:31.232154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:31.232154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:31.232154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:31.232154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:31.232154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:31.232154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:31.233129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:31.233129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:31.233129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:31.233129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:31.233129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:31.233129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:31.233129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:31.233129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:31.233129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:31.233129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:31.233129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:31.233129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:31.233129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:31.233129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:39:31.233129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:39:31.233129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:31.233880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:31.234731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:31.234731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:31.263690 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:31.264316 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:31.264817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:31.265246 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:31.265465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:31.266224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:31.266224 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:31.266224 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:31.266224 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:31.266224 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:31.266224 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:31.266224 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:31.266224 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:31.267899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:31.267899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:31.267899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:31.267899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:31.267899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:31.267899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:31.267899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:31.267899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:31.267899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:31.267899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:31.267899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:31.267899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:31.267899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:31.267899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:39:31.267899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:31.267899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:31.267899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:31.268648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:35.841870 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:35.843750 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:35.880576 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:35.881011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:35.882084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:39:35.882084 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:35.882084 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:35.882084 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:35.882084 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:35.882084 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:35.882084 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:35.882084 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:35.883044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:35.883044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:35.883044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:35.883044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:35.883044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:35.883044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:35.883044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:35.883044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:35.883044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:35.883044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:35.883044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:35.883044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:35.883044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:35.883044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:39:35.883044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:35.883044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:35.883044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:35.883836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:35.909766 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:35.910907 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:35.911272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:35.912229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:35.912229 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:35.912229 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:35.912229 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:35.912229 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:35.912229 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:35.912229 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:35.912229 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:35.913952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:35.913952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:35.913952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:35.913952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:35.913952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:35.913952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:35.913952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:35.913952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:35.913952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:35.913952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:35.913952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:35.913952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:35.913952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:35.913952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:39:35.913952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:35.913952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:35.913952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:35.914931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:35.991003 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:35.991578 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:39:35.992016 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:35.992275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:35.992844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:39:35.992844 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:35.992844 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:35.992844 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:35.992844 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:35.992844 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:35.992844 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:35.992844 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:35.993639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:35.993639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:35.993639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:35.993639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:35.993639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:35.993639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:35.993639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:35.993639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:35.993639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:35.993639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:35.993639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:35.993639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:35.993639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:35.993639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:35.993639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:35.994365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:35.994365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:35.994365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:35.994365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:35.994365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:35.994365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:35.994365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:35.994365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:35.994365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:35.994771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:35.994771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:35.994771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:35.994771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:35.994771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:35.994771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:35.994771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:35.994771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:35.994771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:35.994771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:35.994771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:35.994771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:35.994771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:35.994771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:39:35.994771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:39:35.994771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:35.995451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:35.996235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:35.996235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:35.996235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:36.228692 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:36.229093 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:36.229685 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:36.230110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:36.231162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:36.231162 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:36.231162 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:36.231162 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:36.231162 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:36.231162 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:36.231162 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:36.231162 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:36.232525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:36.232525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:36.232525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:36.232525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:36.232525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:36.232525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:36.232525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:36.232525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:36.232525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:36.232525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:36.232525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:36.232525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:36.232525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:36.232525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:36.232525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:36.232525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:36.233288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:36.233288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:36.233288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:36.233288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:36.233288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:36.233288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:36.233288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:36.233288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:36.234299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:36.234299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:36.234299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:36.234299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:36.234299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:36.234299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:36.234299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:36.234299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:36.234299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:36.234299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:36.234299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:36.234299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:36.234299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:36.234299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:39:36.234299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:39:36.234299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:36.234823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:36.235296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:36.235296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:36.264173 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:36.264547 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:36.265063 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:36.265423 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:36.265613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:36.266486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:36.266486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:36.266486 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:36.266486 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:36.266486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:36.266486 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:36.266486 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:36.266486 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:36.268261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:36.268261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:36.268261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:36.268261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:36.268261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:36.268261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:36.268261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:36.268261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:36.268261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:36.268261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:36.268261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:36.268261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:36.268261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:36.268261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:39:36.268261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:36.268261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:36.268261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:36.268703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:40.842621 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:40.844465 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:40.880250 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:40.881023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:40.881964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:39:40.881964 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:40.881964 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:40.881964 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:40.881964 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:40.881964 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:40.881964 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:40.881964 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:40.883255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:40.883255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:40.883255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:40.883255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:40.883255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:40.883255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:40.883255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:40.883255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:40.883255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:40.883255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:40.883255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:40.883255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:40.883255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:40.883255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:39:40.883255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:40.883255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:40.883255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:40.884185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:40.910346 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:40.911593 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:40.911970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:40.912847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:40.912847 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:40.912847 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:40.912847 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:40.912847 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:40.912847 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:40.912847 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:40.912847 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:40.914449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:40.914449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:40.914449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:40.914449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:40.914449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:40.914449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:40.914449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:40.914449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:40.914449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:40.914449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:40.914449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:40.914449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:40.914449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:40.914449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:39:40.914449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:40.914449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:40.914449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:40.915404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:40.991838 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:40.992603 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:39:40.993249 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:40.993603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:40.994584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:39:40.994584 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:40.994584 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:40.994584 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:40.994584 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:40.994584 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:40.994584 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:40.994584 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:40.995845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:40.995845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:40.995845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:40.995845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:40.995845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:40.995845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:40.995845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:40.995845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:40.995845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:40.995845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:40.995845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:40.995845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:40.995845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:40.995845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:40.995845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:40.996600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:40.996600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:40.996600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:40.996600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:40.996600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:40.996600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:40.996600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:40.996600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:40.996600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:40.997533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:40.997533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:40.997533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:40.997533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:40.997533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:40.997533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:40.997533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:40.997533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:40.997533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:40.997533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:40.997533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:40.997533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:40.997533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:40.997533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:39:40.997533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:39:40.997533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:40.998295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:40.999102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:40.999102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:40.999102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:41.229261 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:41.229777 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:41.230450 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:41.230698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:41.231305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:41.231305 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:41.231305 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:41.231305 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:41.231305 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:41.231305 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:41.231305 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:41.231305 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:41.232648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:41.232648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:41.232648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:41.232648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:41.232648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:41.232648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:41.232648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:41.232648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:41.232648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:41.232648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:41.232648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:41.232648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:41.232648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:41.232648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:41.232648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:41.232648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:41.233150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:41.233150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:41.233150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:41.233150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:41.233150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:41.233150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:41.233150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:41.233150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:41.234507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:41.234507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:41.234507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:41.234507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:41.234507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:41.234507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:41.234507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:41.234507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:41.234507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:41.234507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:41.234507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:41.234507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:41.234507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:41.234507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:39:41.234507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:39:41.234507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:41.235459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:41.236338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:41.236338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:41.264632 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:41.265115 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:41.265552 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:41.265935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:41.266159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:41.266820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:41.266820 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:41.266820 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:41.266820 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:41.266820 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:41.266820 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:41.266820 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:41.266820 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:41.268378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:41.268378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:41.268378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:41.268378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:41.268378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:41.268378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:41.268378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:41.268378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:41.268378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:41.268378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:41.268378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:41.268378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:41.268378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:41.268378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:39:41.268378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:41.268378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:41.268378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:41.269171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:45.843383 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:45.845029 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:45.878611 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:45.879055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:45.880002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:39:45.880002 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:45.880002 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:45.880002 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:45.880002 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:45.880002 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:45.880002 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:45.880002 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:45.881158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:45.881158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:45.881158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:45.881158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:45.881158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:45.881158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:45.881158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:45.881158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:45.881158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:45.881158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:45.881158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:45.881158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:45.881158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:45.881158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:39:45.881158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:45.881158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:45.881158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:45.882255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:45.910937 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:45.911896 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:45.912246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:45.913024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:45.913024 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:45.913024 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:45.913024 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:45.913024 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:45.913024 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:45.913024 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:45.913024 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:45.914748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:45.914748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:45.914748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:45.914748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:45.914748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:45.914748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:45.914748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:45.914748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:45.914748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:45.914748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:45.914748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:45.914748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:45.914748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:45.914748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:39:45.914748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:45.914748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:45.914748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:45.915944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:45.992488 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:45.992957 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:39:45.993541 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:45.993860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:45.994837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:39:45.994837 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:45.994837 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:45.994837 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:45.994837 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:45.994837 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:45.994837 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:45.994837 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:45.996186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:45.996186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:45.996186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:45.996186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:45.996186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:45.996186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:45.996186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:45.996186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:45.996186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:45.996186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:45.996186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:45.996186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:45.996186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:45.996186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:45.996186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:45.996814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:45.996814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:45.996814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:45.996814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:45.996814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:45.996814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:45.996814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:45.996814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:45.996814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:45.997739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:45.997739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:45.997739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:45.997739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:45.997739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:45.997739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:45.997739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:45.997739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:45.997739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:45.997739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:45.997739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:45.997739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:45.997739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:45.997739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:39:45.997739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:39:45.997739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:45.998413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:45.999253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:45.999253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:45.999253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:46.229873 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:46.230469 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:46.231249 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:46.231768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:46.232590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:46.232590 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:46.232590 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:46.232590 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:46.232590 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:46.232590 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:46.232590 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:46.232590 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:46.233827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:46.233827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:46.233827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:46.233827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:46.233827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:46.233827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:46.233827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:46.233827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:46.233827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:46.233827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:46.233827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:46.233827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:46.233827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:46.233827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:46.233827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:46.233827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:46.234542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:46.234542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:46.234542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:46.234542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:46.234542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:46.234542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:46.234542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:46.234542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:46.235409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:46.235409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:46.235409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:46.235409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:46.235409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:46.235409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:46.235409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:46.235409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:46.235409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:46.235409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:46.235409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:46.235409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:46.235409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:46.235409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:39:46.235409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:39:46.235409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:46.236128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:46.236934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:46.236934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:46.265194 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:46.265630 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:46.266135 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:46.266470 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:46.266665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:46.267476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:46.267476 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:46.267476 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:46.267476 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:46.267476 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:46.267476 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:46.267476 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:46.267476 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:46.269103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:46.269103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:46.269103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:46.269103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:46.269103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:46.269103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:46.269103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:46.269103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:46.269103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:46.269103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:46.269103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:46.269103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:46.269103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:46.269103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:39:46.269103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:46.269103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:46.269103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:46.269941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:50.844197 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:50.845830 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:50.878327 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:50.878592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:50.879225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:39:50.879225 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:50.879225 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:50.879225 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:50.879225 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:50.879225 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:50.879225 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:50.879225 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:50.880120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:50.880120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:50.880120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:50.880120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:50.880120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:50.880120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:50.880120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:50.880120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:50.880120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:50.880120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:50.880120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:50.880120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:50.880120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:50.880120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:39:50.880120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:50.880120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:50.880120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:50.880977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:50.911690 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:50.912355 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:50.912453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:50.912828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:50.912828 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:50.912828 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:50.912828 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:50.912828 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:50.912828 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:50.912828 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:50.912828 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:50.913602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:50.913602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:50.913602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:50.913602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:50.913602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:50.913602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:50.913602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:50.913602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:50.913602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:50.913602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:50.913602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:50.913602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:50.913602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:50.913602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:39:50.913602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:50.913602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:50.913602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:50.914415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:50.993203 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:50.993788 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:39:50.994374 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:50.994668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:50.995486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:39:50.995486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:50.995486 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:50.995486 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:50.995486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:50.995486 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:50.995486 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:50.995486 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:50.996641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:50.996641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:50.996641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:50.996641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:50.996641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:50.996641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:50.996641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:50.996641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:50.996641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:50.996641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:50.996641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:50.996641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:50.996641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:50.996641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:50.996641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:50.997411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:50.997411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:50.997411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:50.997411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:50.997411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:50.997411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:50.997411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:50.997411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:50.997411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:50.998228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:50.998228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:50.998228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:50.998228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:50.998228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:50.998228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:50.998228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:50.998228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:50.998228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:50.998228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:50.998228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:50.998228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:50.998228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:50.998228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:39:50.998228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:39:50.998228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:50.998963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:50.999803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:50.999803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:50.999803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:51.230550 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:51.231408 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:51.231883 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:51.232306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:51.233124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:51.233124 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:51.233124 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:51.233124 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:51.233124 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:51.233124 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:51.233124 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:51.233124 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:51.234502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:51.234502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:51.234502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:51.234502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:51.234502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:51.234502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:51.234502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:51.234502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:51.234502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:51.234502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:51.234502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:51.234502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:51.234502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:51.234502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:51.234502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:51.234502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:51.235653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:51.235653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:51.235653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:51.235653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:51.235653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:51.235653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:51.235653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:51.235653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:51.236210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:51.236210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:51.236210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:51.236210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:51.236210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:51.236210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:51.236210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:51.236210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:51.236210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:51.236210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:51.236210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:51.236210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:51.236210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:51.236210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:39:51.236210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:39:51.236210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:51.237241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:51.238358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:51.238358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:51.265737 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:51.266483 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:51.266927 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:51.267109 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:51.267245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:51.267822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:51.267822 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:51.267822 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:51.267822 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:51.267822 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:51.267822 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:51.267822 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:51.267822 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:51.269628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:51.269628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:51.269628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:51.269628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:51.269628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:51.269628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:51.269628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:51.269628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:51.269628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:51.269628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:51.269628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:51.269628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:51.269628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:51.269628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:39:51.269628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:51.269628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:51.269628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:51.270478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:55.845598 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:55.848372 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:55.883968 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:55.884414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:55.886023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:39:55.886023 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:55.886023 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:55.886023 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:55.886023 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:55.886023 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:55.886023 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:55.886023 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:55.887353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:55.887353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:55.887353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:55.887353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:55.887353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:55.887353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:55.887353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:55.887353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:55.887353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:55.887353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:55.887353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:55.887353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:55.887353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:55.887353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:39:55.887353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:55.887353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:55.887353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:55.888688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:55.912190 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:55.913273 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:55.913586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:55.914458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:55.914458 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:55.914458 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:55.914458 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:55.914458 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:55.914458 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:55.914458 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:55.914458 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:55.917042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:55.917042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:55.917042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:55.917042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:55.917042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:55.917042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:55.917042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:55.917042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:55.917042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:55.917042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:55.917042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:55.917042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:55.917042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:55.917042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:39:55.917042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:55.917042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:55.917042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:55.917834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:55.994132 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:55.994631 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:39:55.995072 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:55.995341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:55.995913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:39:55.995913 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:55.995913 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:55.995913 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:55.995913 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:55.995913 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:55.995913 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:55.995913 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:55.996839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:55.996839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:55.996839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:55.996839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:55.996839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:55.996839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:55.996839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:55.996839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:55.996839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:55.996839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:55.996839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:55.996839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:55.996839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:55.996839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:55.996839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:55.997276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:55.997276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:55.997276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:55.997276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:55.997276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:55.997276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:55.997276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:55.997276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:55.997276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:55.997886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:55.997886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:55.997886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:55.997886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:55.997886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:55.997886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:55.997886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:55.997886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:55.997886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:55.997886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:55.997886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:55.997886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:55.997886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:55.997886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:39:55.997886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:39:55.997886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:55.998323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:55.998792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:55.998792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:55.998792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:56.231630 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:56.232424 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:56.233268 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:56.233721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:56.234716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:56.234716 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:56.234716 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:56.234716 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:56.234716 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:56.234716 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:56.234716 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:56.234716 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:56.236169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:56.236169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:39:56.236169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:56.236169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:56.236169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:56.236169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:56.236169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:56.236169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:56.236169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:56.236169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:39:56.236169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:56.236169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:39:56.236169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:56.236169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:39:56.236169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:39:56.236169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:56.236886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:39:56.236886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:56.236886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:39:56.236886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:39:56.236886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:56.236886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:39:56.236886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:56.236886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:39:56.238101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:56.238101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:56.238101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:56.238101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:56.238101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:56.238101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:56.238101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:56.238101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:56.238101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:56.238101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:56.238101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:56.238101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:56.238101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:56.238101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:39:56.238101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:39:56.238101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:56.238569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:56.239082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:56.239082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:39:56.266392 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:39:56.267879 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:39:56.268206 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:56.268624 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:39:56.268834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:56.269901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:39:56.269901 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:56.269901 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:39:56.269901 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:39:56.269901 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:56.269901 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:39:56.269901 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:56.269901 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:39:56.272195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:56.272195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:39:56.272195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:39:56.272195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:39:56.272195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:39:56.272195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:39:56.272195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:56.272195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:39:56.272195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:39:56.272195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:39:56.272195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:39:56.272195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:39:56.272195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:39:56.272195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:39:56.272195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:39:56.272195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:56.272195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:39:56.273012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:00.846481 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:00.847934 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:00.884700 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:00.885140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:00.886048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:40:00.886048 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:00.886048 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:00.886048 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:00.886048 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:00.886048 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:00.886048 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:00.886048 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:00.887236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:00.887236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:00.887236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:00.887236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:00.887236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:00.887236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:00.887236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:00.887236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:00.887236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:00.887236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:00.887236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:00.887236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:00.887236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:00.887236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:40:00.887236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:00.887236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:00.887236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:00.888080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:00.912680 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:00.914059 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:00.914059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:00.915092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:00.915092 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:00.915092 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:00.915092 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:00.915092 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:00.915092 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:00.915092 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:00.915092 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:00.916525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:00.916525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:00.916525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:00.916525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:00.916525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:00.916525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:00.916525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:00.916525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:00.916525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:00.916525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:00.916525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:00.916525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:00.916525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:00.916525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:40:00.916525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:00.916525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:00.916525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:00.917271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:00.994841 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:00.995499 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:40:00.996334 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:00.996693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:00.997583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:40:00.997583 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:00.997583 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:00.997583 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:00.997583 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:00.997583 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:00.997583 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:00.997583 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:00.998917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:00.998917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:00.998917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:00.998917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:00.998917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:00.998917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:00.998917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:00.998917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:00.998917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:00.998917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:00.998917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:00.998917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:00.998917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:00.998917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:00.998917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:00.999653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:00.999653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:00.999653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:00.999653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:00.999653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:00.999653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:00.999653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:00.999653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:00.999653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:01.000603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:01.000603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:01.000603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:01.000603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:01.000603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:01.000603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:01.000603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:01.000603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:01.000603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:01.000603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:01.000603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:01.000603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:01.000603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:01.000603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:40:01.000603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:40:01.000603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:01.001342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:01.002183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:01.002183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:01.002183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:01.232378 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:01.233016 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:01.233810 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:01.234301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:01.235164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:01.235164 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:01.235164 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:01.235164 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:01.235164 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:01.235164 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:01.235164 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:01.235164 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:01.236690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:01.236690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:01.236690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:01.236690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:01.236690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:01.236690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:01.236690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:01.236690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:01.236690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:01.236690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:01.236690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:01.236690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:01.236690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:01.236690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:01.236690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:01.236690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:01.237469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:01.237469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:01.237469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:01.237469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:01.237469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:01.237469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:01.237469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:01.237469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:01.238547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:01.238547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:01.238547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:01.238547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:01.238547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:01.238547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:01.238547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:01.238547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:01.238547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:01.238547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:01.238547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:01.238547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:01.238547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:01.238547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:40:01.238547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:40:01.238547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:01.239341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:01.240193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:01.240193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:01.267121 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:01.267514 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:01.267954 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:01.268238 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:01.268364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:01.268881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:01.268881 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:01.268881 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:01.268881 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:01.268881 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:01.268881 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:01.268881 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:01.268881 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:01.270541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:01.270541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:01.270541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:01.270541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:01.270541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:01.270541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:01.270541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:01.270541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:01.270541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:01.270541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:01.270541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:01.270541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:01.270541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:01.270541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:40:01.270541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:01.270541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:01.270541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:01.271010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:05.847076 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:05.848941 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:05.887169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:05.887639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:05.888796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:40:05.888796 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:05.888796 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:05.888796 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:05.888796 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:05.888796 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:05.888796 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:05.888796 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:05.890601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:05.890601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:05.890601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:05.890601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:05.890601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:05.890601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:05.890601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:05.890601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:05.890601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:05.890601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:05.890601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:05.890601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:05.890601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:05.890601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:40:05.890601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:05.890601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:05.890601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:05.891893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:05.913209 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:05.914287 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:05.914581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:05.915383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:05.915383 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:05.915383 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:05.915383 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:05.915383 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:05.915383 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:05.915383 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:05.915383 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:05.916910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:05.916910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:05.916910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:05.916910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:05.916910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:05.916910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:05.916910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:05.916910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:05.916910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:05.916910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:05.916910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:05.916910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:05.916910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:05.916910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:40:05.916910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:05.916910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:05.916910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:05.918241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:05.995449 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:05.996117 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:40:05.996848 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:05.997187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:05.998147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:40:05.998147 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:05.998147 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:05.998147 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:05.998147 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:05.998147 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:05.998147 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:05.998147 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:05.999468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:05.999468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:05.999468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:05.999468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:05.999468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:05.999468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:05.999468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:05.999468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:05.999468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:05.999468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:05.999468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:05.999468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:05.999468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:05.999468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:05.999468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:06.000194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:06.000194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:06.000194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:06.000194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:06.000194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:06.000194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:06.000194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:06.000194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:06.000194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:06.001063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:06.001063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:06.001063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:06.001063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:06.001063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:06.001063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:06.001063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:06.001063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:06.001063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:06.001063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:06.001063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:06.001063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:06.001063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:06.001063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:40:06.001063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:40:06.001063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:06.001765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:06.002542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:06.002542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:06.002542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:06.233029 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:06.233695 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:06.234386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:06.234848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:06.235750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:06.235750 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:06.235750 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:06.235750 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:06.235750 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:06.235750 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:06.235750 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:06.235750 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:06.237217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:06.237217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:06.237217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:06.237217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:06.237217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:06.237217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:06.237217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:06.237217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:06.237217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:06.237217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:06.237217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:06.237217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:06.237217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:06.237217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:06.237217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:06.237217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:06.238247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:06.238247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:06.238247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:06.238247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:06.238247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:06.238247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:06.238247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:06.238247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:06.241007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:06.241007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:06.241007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:06.241007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:06.241007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:06.241007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:06.241007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:06.241007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:06.241007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:06.241007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:06.241007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:06.241007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:06.241007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:06.241007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:40:06.241007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:40:06.241007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:06.242075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:06.243925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:06.243925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:06.267657 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:06.268295 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:06.268941 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:06.269475 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:06.269720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:06.270628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:06.270628 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:06.270628 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:06.270628 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:06.270628 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:06.270628 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:06.270628 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:06.270628 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:06.272572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:06.272572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:06.272572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:06.272572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:06.272572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:06.272572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:06.272572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:06.272572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:06.272572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:06.272572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:06.272572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:06.272572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:06.272572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:06.272572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:40:06.272572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:06.272572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:06.272572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:06.273403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:10.847762 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:10.849219 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:10.877739 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:10.878155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:10.879158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:40:10.879158 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:10.879158 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:10.879158 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:10.879158 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:10.879158 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:10.879158 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:10.879158 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:10.880894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:10.880894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:10.880894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:10.880894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:10.880894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:10.880894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:10.880894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:10.880894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:10.880894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:10.880894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:10.880894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:10.880894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:10.880894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:10.880894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:40:10.880894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:10.880894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:10.880894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:10.881936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:10.913731 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:10.914694 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:10.915145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:10.915954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:10.915954 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:10.915954 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:10.915954 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:10.915954 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:10.915954 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:10.915954 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:10.915954 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:10.917717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:10.917717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:10.917717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:10.917717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:10.917717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:10.917717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:10.917717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:10.917717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:10.917717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:10.917717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:10.917717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:10.917717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:10.917717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:10.917717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:40:10.917717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:10.917717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:10.917717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:10.918257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:10.996083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:10.996567 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:40:10.997230 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:10.997574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:10.998586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:40:10.998586 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:10.998586 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:10.998586 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:10.998586 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:10.998586 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:10.998586 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:10.998586 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:10.999717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:10.999717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:10.999717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:10.999717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:10.999717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:10.999717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:10.999717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:10.999717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:10.999717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:10.999717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:10.999717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:10.999717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:10.999717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:10.999717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:10.999717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:11.000679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:11.000679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:11.000679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:11.000679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:11.000679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:11.000679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:11.000679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:11.000679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:11.000679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:11.001497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:11.001497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:11.001497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:11.001497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:11.001497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:11.001497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:11.001497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:11.001497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:11.001497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:11.001497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:11.001497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:11.001497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:11.001497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:11.001497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:40:11.001497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:40:11.001497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:11.002123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:11.002667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:11.002667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:11.002667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:11.233795 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:11.234394 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:11.234912 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:11.235423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:11.236720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:11.236720 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:11.236720 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:11.236720 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:11.236720 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:11.236720 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:11.236720 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:11.236720 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:11.238390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:11.238390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:11.238390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:11.238390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:11.238390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:11.238390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:11.238390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:11.238390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:11.238390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:11.238390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:11.238390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:11.238390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:11.238390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:11.238390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:11.238390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:11.238390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:11.239196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:11.239196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:11.239196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:11.239196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:11.239196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:11.239196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:11.239196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:11.239196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:11.239925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:11.239925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:11.239925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:11.239925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:11.239925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:11.239925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:11.239925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:11.239925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:11.239925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:11.239925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:11.239925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:11.239925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:11.239925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:11.239925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:40:11.239925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:40:11.239925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:11.240689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:11.241562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:11.241562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:11.268283 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:11.268837 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:11.269328 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:11.269586 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:11.269829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:11.270419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:11.270419 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:11.270419 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:11.270419 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:11.270419 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:11.270419 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:11.270419 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:11.270419 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:11.272172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:11.272172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:11.272172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:11.272172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:11.272172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:11.272172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:11.272172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:11.272172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:11.272172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:11.272172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:11.272172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:11.272172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:11.272172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:11.272172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:40:11.272172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:11.272172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:11.272172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:11.272910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:15.794090 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:15.797539 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=260 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:40:15.803835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a2f381f-a890-499f-91c0-92d444eced6e None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 07 19:40:15.804235 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a2f381f-a890-499f-91c0-92d444eced6e None None] Maintenance task: Number of inconsistencies found at create/update: networks=2, security_groups=1 {{(pid=104575) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 07 19:40:15.804444 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a2f381f-a890-499f-91c0-92d444eced6e None None] Maintenance task: Fixing resource bfbf6c8f-1f7e-474c-a618-4e99355c0282 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:40:15.843806 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, resource={'id': 'bfbf6c8f-1f7e-474c-a618-4e99355c0282', 'name': 'private', 'tenant_id': '47ea4a7c5a154b528631c5537cfdb850', 'project_id': '47ea4a7c5a154b528631c5537cfdb850', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['49f10797-7993-4eac-ad9c-5db13bcf3a17', 'bdd6f685-b77d-459b-b386-e3ef09898997'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:35:01Z', 'updated_at': '2026-04-07T19:35:05Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39614}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:15.844256 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:15.844786 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-ca0b7fb0-3499-4804-b894-4bb867203f37, external_ids_update=None, columns={'tag': 39614}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:15.845082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:15.846149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a2f381f-a890-499f-91c0-92d444eced6e None None] Traceback (most recent call last):
Apr 07 19:40:15.846149 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:15.846149 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:15.846149 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:15.846149 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:15.846149 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:15.846149 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:15.846149 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:15.847134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a2f381f-a890-499f-91c0-92d444eced6e None None] Maintenance task: Failed to fix resource bfbf6c8f-1f7e-474c-a618-4e99355c0282 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:15.847134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:40:15.847134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:40:15.847134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:40:15.847134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:40:15.847134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:40:15.847134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 19:40:15.847134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:15.847134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:15.847134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:40:15.847134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:15.847510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:15.847510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:15.847510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:40:15.847510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:15.847510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:40:15.847510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:15.847510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:40:15.847510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:40:15.847510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:15.847510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:40:15.847510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:15.847510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:40:15.847510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:40:15.847510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:15.847915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:40:15.847915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:15.847915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:40:15.847915 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a2f381f-a890-499f-91c0-92d444eced6e None None] Maintenance task: Fixing resource 92857a9a-261a-45c8-bdf2-793e5d5977e1 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:40:15.848438 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:15.853317 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:15.900386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, resource={'id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'name': 'public', 'tenant_id': '47ea4a7c5a154b528631c5537cfdb850', 'project_id': '47ea4a7c5a154b528631c5537cfdb850', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['158905cc-b5be-42da-8777-3d7ded042b7c', '6de186a3-9e7c-4950-a1c6-817a37a68984'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-07T19:35:09Z', 'updated_at': '2026-04-07T19:35:17Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:15.900493 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:15.901216 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-783e27a6-53d0-42e0-a778-7125c7a0cff1, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:15.901559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:15.902934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a2f381f-a890-499f-91c0-92d444eced6e None None] Traceback (most recent call last):
Apr 07 19:40:15.902934 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:15.902934 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:15.902934 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:15.902934 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:15.902934 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:15.902934 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:15.902934 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:15.904541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a2f381f-a890-499f-91c0-92d444eced6e None None] Maintenance task: Failed to fix resource 92857a9a-261a-45c8-bdf2-793e5d5977e1 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:15.904541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:40:15.904541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:40:15.904541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:40:15.904541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:40:15.904541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:40:15.904541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 19:40:15.904541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:15.904541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:15.904541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:40:15.904541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:15.904956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:15.904956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:15.904956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:40:15.904956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:15.904956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:40:15.904956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:15.904956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:40:15.904956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:40:15.904956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:15.904956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:40:15.904956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:15.904956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:40:15.904956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:40:15.904956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:15.905396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:40:15.905396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:15.905396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:40:15.905396 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:15.905396 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a2f381f-a890-499f-91c0-92d444eced6e None None] Maintenance task: Fixing resource 16746d44-d49b-46f5-8003-4f543471dd13 (type: security_groups) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:40:15.905928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:15.906600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:40:15.906600 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:15.906600 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:15.906600 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:15.906600 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:15.906600 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:15.906600 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:15.906600 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:15.917117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:15.917117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:15.917117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:15.917117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:15.917117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:15.917117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:15.917117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:15.917117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:15.917117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:15.917117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:15.917117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:15.917117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:15.917117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:15.917117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:40:15.917117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:15.917117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:15.917117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:15.917809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:15.918409 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:15.921489 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:15.921765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:15.924954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:15.924954 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:15.924954 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:15.924954 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:15.924954 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:15.924954 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:15.924954 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:15.924954 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:15.926150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:15.926150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:15.926150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:15.926150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:15.926150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:15.926150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:15.926150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:15.926150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:15.926150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:15.926150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:15.926150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:15.926150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:15.926150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:15.926150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:40:15.926150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:15.926150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:15.926150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:15.926914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:15.972481 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.db.ovn_revision_numbers_db [None req-4a2f381f-a890-499f-91c0-92d444eced6e None None] Successfully bumped revision number for resource 16746d44-d49b-46f5-8003-4f543471dd13 (type: security_groups) to 9
Apr 07 19:40:15.972750 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4a2f381f-a890-499f-91c0-92d444eced6e None None] Maintenance task: Synchronization completed (took 0.17 seconds)
Apr 07 19:40:15.996678 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:15.997623 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:40:15.998302 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:15.998708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:16.002437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:16.003331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:16.003331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:16.003331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:16.003331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:16.003331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:16.003331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:16.003331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:16.003331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:16.003331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:16.003331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:16.003331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:16.003331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:16.003331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:16.003331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:16.004264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:16.004264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:16.004264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:16.004264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:16.004264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:16.004264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:16.004264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:16.004264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:16.004264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:16.004264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:16.004264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:16.004264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:16.004264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:16.004264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:40:16.004264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:40:16.004264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:16.005027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:16.005915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:16.005915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:16.005915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:16.234598 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:16.234958 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:16.235526 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:16.235955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:16.236743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:16.236743 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:16.236743 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:16.236743 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:16.236743 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:16.236743 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:16.236743 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:16.236743 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:16.237956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:16.237956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:16.237956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:16.237956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:16.237956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:16.237956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:16.237956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:16.237956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:16.237956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:16.237956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:16.237956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:16.237956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:16.237956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:16.237956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:16.237956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:16.237956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:16.238726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:16.238726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:16.238726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:16.238726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:16.238726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:16.238726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:16.238726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:16.238726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:16.239894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:16.239894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:16.239894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:16.239894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:16.239894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:16.239894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:16.239894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:16.239894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:16.239894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:16.239894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:16.239894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:16.239894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:16.239894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:16.239894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:40:16.239894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:40:16.239894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:16.240634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:16.241542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:16.241542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:16.268649 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:16.269388 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:16.269873 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:16.270285 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:16.270484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:16.271267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:16.271267 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:16.271267 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:16.271267 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:16.271267 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:16.271267 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:16.271267 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:16.271267 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:16.272942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:16.272942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:16.272942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:16.272942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:16.272942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:16.272942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:16.272942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:16.272942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:16.272942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:16.272942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:16.272942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:16.272942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:16.272942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:16.272942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:40:16.272942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:16.272942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:16.272942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:16.273715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:20.850479 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:20.852417 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:20.883573 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:20.883727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:20.884212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:40:20.884212 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:20.884212 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:20.884212 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:20.884212 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:20.884212 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:20.884212 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:20.884212 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:20.884965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:20.884965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:20.884965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:20.884965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:20.884965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:20.884965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:20.884965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:20.884965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:20.884965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:20.884965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:20.884965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:20.884965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:20.884965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:20.884965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:40:20.884965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:20.884965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:20.884965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:20.885857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:20.918019 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:20.919188 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:20.919595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:20.920870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:40:20.920870 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:20.920870 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:20.920870 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:20.920870 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:20.920870 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:20.920870 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:20.920870 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:20.922770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:20.922770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:20.922770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:20.922770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:20.922770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:20.922770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:20.922770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:20.922770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:20.922770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:20.922770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:20.922770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:20.922770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:20.922770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:20.922770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:40:20.922770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:20.922770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:20.923577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:20.997557 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:20.998223 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:40:20.998814 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:20.999170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:21.000005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:40:21.000005 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:21.000005 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:21.000005 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:21.000005 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:21.000005 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:21.000005 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:21.000005 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:21.001453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:21.001453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:21.001453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:21.001453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:21.001453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:21.001453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:21.001453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:21.001453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:21.001453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:21.001453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:21.001453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:21.001453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:21.001453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:21.001453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:21.001453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:21.002188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:21.002188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:21.002188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:21.002188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:21.002188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:21.002188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:21.002188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:21.002188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:21.002188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:21.003037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:21.003037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:21.003037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:21.003037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:21.003037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:21.003037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:21.003037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:21.003037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:21.003037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:21.003037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:21.003037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:21.003037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:21.003037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:21.003037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:40:21.003037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:40:21.003037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:21.003864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:21.004746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:21.004746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:21.004746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:21.235274 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:21.235767 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:21.236403 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:21.236689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:21.237344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:21.237344 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:21.237344 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:21.237344 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:21.237344 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:21.237344 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:21.237344 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:21.237344 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:21.238335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:21.238335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:21.238335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:21.238335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:21.238335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:21.238335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:21.238335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:21.238335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:21.238335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:21.238335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:21.238335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:21.238335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:21.238335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:21.238335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:21.238335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:21.238335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:21.239316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:21.239316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:21.239316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:21.239316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:21.239316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:21.239316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:21.239316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:21.239316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:21.239761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:21.239761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:21.239761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:21.239761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:21.239761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:21.239761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:21.239761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:21.239761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:21.239761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:21.239761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:21.239761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:21.239761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:21.239761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:21.239761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:40:21.239761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:40:21.239761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:21.240534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:21.241284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:21.241284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:21.269237 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:21.269582 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:21.270156 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:21.270589 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:21.270790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:21.271559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:21.271559 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:21.271559 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:21.271559 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:21.271559 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:21.271559 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:21.271559 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:21.271559 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:21.273082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:21.273082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:21.273082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:21.273082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:21.273082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:21.273082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:21.273082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:21.273082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:21.273082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:21.273082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:21.273082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:21.273082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:21.273082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:21.273082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:40:21.273082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:21.273082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:21.273082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:21.273552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:25.851300 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:25.853520 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:25.887721 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:25.887970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:25.888664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:40:25.888664 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:25.888664 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:25.888664 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:25.888664 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:25.888664 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:25.888664 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:25.888664 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:25.889651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:25.889651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:25.889651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:25.889651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:25.889651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:25.889651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:25.889651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:25.889651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:25.889651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:25.889651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:25.889651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:25.889651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:25.889651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:25.889651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:40:25.889651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:25.889651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:25.889651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:25.890287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:25.918568 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:25.919583 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:25.920166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:25.921050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:40:25.921050 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:25.921050 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:25.921050 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:25.921050 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:25.921050 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:25.921050 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:25.921050 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:25.922941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:25.922941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:25.922941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:25.922941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:25.922941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:25.922941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:25.922941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:25.922941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:25.922941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:25.922941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:25.922941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:25.922941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:25.922941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:25.922941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:40:25.922941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:25.922941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:25.923640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:25.997953 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:25.998657 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:40:25.999191 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:25.999416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:26.000062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:40:26.000062 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:26.000062 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:26.000062 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:26.000062 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:26.000062 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:26.000062 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:26.000062 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:26.001133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:26.001133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:26.001133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:26.001133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:26.001133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:26.001133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:26.001133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:26.001133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:26.001133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:26.001133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:26.001133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:26.001133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:26.001133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:26.001133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:26.001133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:26.001533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:26.001533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:26.001533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:26.001533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:26.001533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:26.001533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:26.001533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:26.001533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:26.001533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:26.002381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:26.002381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:26.002381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:26.002381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:26.002381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:26.002381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:26.002381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:26.002381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:26.002381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:26.002381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:26.002381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:26.002381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:26.002381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:26.002381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:40:26.002381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:40:26.002381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:26.002826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:26.003333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:26.003333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:26.003333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:26.235920 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:26.236545 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:26.237177 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:26.237648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:26.238514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:26.238514 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:26.238514 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:26.238514 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:26.238514 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:26.238514 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:26.238514 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:26.238514 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:26.239862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:26.239862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:26.239862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:26.239862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:26.239862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:26.239862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:26.239862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:26.239862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:26.239862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:26.239862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:26.239862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:26.239862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:26.239862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:26.239862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:26.239862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:26.239862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:26.240492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:26.240492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:26.240492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:26.240492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:26.240492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:26.240492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:26.240492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:26.240492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:26.241681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:26.241681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:26.241681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:26.241681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:26.241681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:26.241681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:26.241681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:26.241681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:26.241681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:26.241681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:26.241681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:26.241681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:26.241681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:26.241681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:40:26.241681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:40:26.241681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:26.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:26.243027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:26.243027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:26.269867 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:26.270362 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:26.270897 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:26.271325 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:26.271513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:26.272334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:26.272334 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:26.272334 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:26.272334 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:26.272334 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:26.272334 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:26.272334 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:26.272334 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:26.273797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:26.273797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:26.273797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:26.273797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:26.273797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:26.273797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:26.273797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:26.273797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:26.273797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:26.273797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:26.273797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:26.273797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:26.273797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:26.273797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:40:26.273797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:26.273797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:26.273797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:26.274841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:30.853248 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:30.854964 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:30.900092 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:30.900553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:30.901525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:40:30.901525 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:30.901525 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:30.901525 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:30.901525 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:30.901525 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:30.901525 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:30.901525 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:30.902418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:30.902418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:30.902418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:30.902418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:30.902418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:30.902418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:30.902418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:30.902418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:30.902418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:30.902418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:30.902418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:30.902418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:30.902418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:30.902418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:40:30.902418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:30.902418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:30.902418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:30.903153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:30.919110 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:30.920017 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:30.920502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:30.921892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:40:30.921892 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:30.921892 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:30.921892 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:30.921892 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:30.921892 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:30.921892 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:30.921892 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:30.923410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:30.923410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:30.923410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:30.923410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:30.923410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:30.923410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:30.923410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:30.923410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:30.923410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:30.923410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:30.923410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:30.923410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:30.923410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:30.923410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:40:30.923410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:30.923410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:30.924195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:30.998478 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:30.999256 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:40:31.000109 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:31.000419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:31.001391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:40:31.001391 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:31.001391 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:31.001391 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:31.001391 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:31.001391 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:31.001391 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:31.001391 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:31.002620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:31.002620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:31.002620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:31.002620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:31.002620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:31.002620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:31.002620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:31.002620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:31.002620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:31.002620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:31.002620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:31.002620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:31.002620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:31.002620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:31.002620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:31.003063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:31.003063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:31.003063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:31.003063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:31.003063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:31.003063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:31.003063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:31.003063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:31.003063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:31.003721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:31.003721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:31.003721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:31.003721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:31.003721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:31.003721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:31.003721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:31.003721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:31.003721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:31.003721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:31.003721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:31.003721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:31.003721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:31.003721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:40:31.003721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:40:31.003721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:31.004177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:31.004659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:31.004659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:31.004659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:31.236602 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:31.237130 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:31.238447 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:31.238879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:31.239792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:31.239792 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:31.239792 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:31.239792 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:31.239792 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:31.239792 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:31.239792 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:31.239792 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:31.241018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:31.241018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:31.241018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:31.241018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:31.241018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:31.241018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:31.241018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:31.241018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:31.241018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:31.241018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:31.241018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:31.241018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:31.241018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:31.241018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:31.241018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:31.241018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:31.242002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:31.242002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:31.242002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:31.242002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:31.242002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:31.242002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:31.242002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:31.242002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:31.242002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:31.242002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:31.242002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:31.242002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:31.242002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:31.242002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:31.242002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:31.242002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:31.243010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:31.243443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:31.243443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:31.243443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:31.243443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:31.243443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:31.243443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:31.243443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:31.243443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:31.243443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:31.270351 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:31.270896 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:31.271462 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:31.271826 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:31.272072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:31.272997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:31.272997 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:31.272997 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:31.272997 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:31.272997 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:31.272997 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:31.272997 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:31.272997 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:31.274691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:31.274691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:31.274691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:31.274691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:31.274691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:31.274691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:31.274691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:31.274691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:31.274691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:31.274691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:31.274691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:31.274691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:31.274691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:31.274691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:40:31.274691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:31.274691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:31.274691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:31.275218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:35.853969 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:35.855584 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:35.888981 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:35.889462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:35.890417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:40:35.890417 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:35.890417 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:35.890417 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:35.890417 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:35.890417 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:35.890417 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:35.890417 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:35.891958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:35.891958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:35.891958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:35.891958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:35.891958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:35.891958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:35.891958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:35.891958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:35.891958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:35.891958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:35.891958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:35.891958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:35.891958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:35.891958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:40:35.891958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:35.891958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:35.891958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:35.892775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:35.919764 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:35.921016 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:35.921366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:35.922351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:40:35.922351 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:35.922351 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:35.922351 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:35.922351 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:35.922351 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:35.922351 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:35.922351 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:35.924247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:35.924247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:35.924247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:35.924247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:35.924247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:35.924247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:35.924247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:35.924247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:35.924247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:35.924247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:35.924247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:35.924247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:35.924247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:35.924247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:40:35.924247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:35.924247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:35.925056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:35.999187 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:35.999797 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:40:36.000567 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:36.000872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:36.001732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:40:36.001732 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:36.001732 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:36.001732 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:36.001732 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:36.001732 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:36.001732 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:36.001732 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:36.003016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:36.003016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:36.003016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:36.003016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:36.003016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:36.003016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:36.003016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:36.003016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:36.003016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:36.003016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:36.003016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:36.003016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:36.003016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:36.003016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:36.003016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:36.004085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:36.004085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:36.004085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:36.004085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:36.004085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:36.004085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:36.004085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:36.004085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:36.004085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:36.004699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:36.004699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:36.004699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:36.004699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:36.004699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:36.004699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:36.004699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:36.004699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:36.004699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:36.004699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:36.004699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:36.004699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:36.004699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:36.004699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:40:36.004699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:40:36.004699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:36.005796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:36.006956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:36.006956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:36.006956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:36.237318 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:36.237677 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:36.238146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:36.238425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:36.238957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:36.238957 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:36.238957 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:36.238957 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:36.238957 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:36.238957 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:36.238957 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:36.238957 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:36.239738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:36.239738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:36.239738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:36.239738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:36.239738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:36.239738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:36.239738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:36.239738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:36.239738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:36.239738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:36.239738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:36.239738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:36.239738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:36.239738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:36.239738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:36.239738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:36.240814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:36.240814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:36.240814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:36.240814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:36.240814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:36.240814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:36.240814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:36.240814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:36.240814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:36.240814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:36.240814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:36.240814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:36.240814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:36.240814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:36.240814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:36.240814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:36.241821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:36.243119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:36.243119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:36.243119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:36.243119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:36.243119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:36.243119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:36.243119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:36.243119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:36.243119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:36.270932 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:36.271754 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:36.272288 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:36.272671 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:36.272783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:36.273298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:36.273298 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:36.273298 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:36.273298 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:36.273298 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:36.273298 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:36.273298 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:36.273298 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:36.274923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:36.274923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:36.274923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:36.274923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:36.274923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:36.274923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:36.274923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:36.274923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:36.274923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:36.274923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:36.274923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:36.274923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:36.274923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:36.274923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:40:36.274923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:36.274923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:36.274923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:36.276034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:40.854740 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:40.856509 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:40.889535 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:40.889913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:40.890832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:40:40.890832 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:40.890832 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:40.890832 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:40.890832 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:40.890832 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:40.890832 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:40.890832 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:40.892065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:40.892065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:40.892065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:40.892065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:40.892065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:40.892065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:40.892065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:40.892065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:40.892065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:40.892065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:40.892065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:40.892065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:40.892065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:40.892065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:40:40.892065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:40.892065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:40.892065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:40.892820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:40.920343 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:40.921294 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:40.921602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:40.922542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:40:40.922542 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:40.922542 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:40.922542 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:40.922542 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:40.922542 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:40.922542 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:40.922542 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:40.924620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:40.924620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:40.924620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:40.924620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:40.924620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:40.924620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:40.924620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:40.924620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:40.924620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:40.924620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:40.924620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:40.924620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:40.924620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:40.924620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:40:40.924620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:40.924620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:40.925560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:40.999819 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:41.000492 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:40:41.001244 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:41.001550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:41.002363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:40:41.002363 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:41.002363 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:41.002363 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:41.002363 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:41.002363 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:41.002363 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:41.002363 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:41.003397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:41.003397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:41.003397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:41.003397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:41.003397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:41.003397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:41.003397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:41.003397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:41.003397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:41.003397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:41.003397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:41.003397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:41.003397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:41.003397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:41.003397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:41.004125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:41.004125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:41.004125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:41.004125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:41.004125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:41.004125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:41.004125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:41.004125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:41.004125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:41.004514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:41.004514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:41.004514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:41.004514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:41.004514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:41.004514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:41.004514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:41.004514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:41.004514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:41.004514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:41.004514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:41.004514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:41.004514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:41.004514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:40:41.004514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:40:41.004514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:41.005289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:41.006118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:41.006118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:41.006118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:41.237961 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:41.238212 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:41.238802 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:41.239290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:41.240173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:41.240173 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:41.240173 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:41.240173 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:41.240173 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:41.240173 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:41.240173 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:41.240173 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:41.241260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:41.241260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:41.241260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:41.241260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:41.241260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:41.241260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:41.241260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:41.241260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:41.241260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:41.241260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:41.241260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:41.241260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:41.241260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:41.241260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:41.241260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:41.241260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:41.241771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:41.241771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:41.241771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:41.241771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:41.241771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:41.241771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:41.241771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:41.241771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:41.243009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:41.243009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:41.243009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:41.243009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:41.243009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:41.243009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:41.243009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:41.243009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:41.243009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:41.243009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:41.243009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:41.243009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:41.243009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:41.243009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:40:41.243009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:40:41.243009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:41.243643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:41.244205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:41.244205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:41.271636 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:41.272358 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:41.272831 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:41.273147 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:41.273265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:41.273869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:41.273869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:41.273869 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:41.273869 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:41.273869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:41.273869 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:41.273869 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:41.273869 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:41.275607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:41.275607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:41.275607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:41.275607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:41.275607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:41.275607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:41.275607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:41.275607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:41.275607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:41.275607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:41.275607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:41.275607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:41.275607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:41.275607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:40:41.275607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:41.275607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:41.275607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:41.276133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:45.855390 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:45.857349 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:45.891920 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:45.892441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:45.893330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:40:45.893330 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:45.893330 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:45.893330 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:45.893330 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:45.893330 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:45.893330 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:45.893330 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:45.894239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:45.894239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:45.894239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:45.894239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:45.894239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:45.894239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:45.894239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:45.894239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:45.894239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:45.894239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:45.894239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:45.894239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:45.894239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:45.894239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:40:45.894239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:45.894239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:45.894239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:45.895088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:45.920709 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:45.921765 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:45.922222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:45.923381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:40:45.923381 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:45.923381 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:45.923381 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:45.923381 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:45.923381 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:45.923381 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:45.923381 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:45.925072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:45.925072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:45.925072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:45.925072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:45.925072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:45.925072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:45.925072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:45.925072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:45.925072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:45.925072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:45.925072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:45.925072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:45.925072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:45.925072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:40:45.925072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:45.925072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:45.925939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:46.000546 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:46.001308 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:40:46.002234 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:46.002555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:46.003466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:40:46.003466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:46.003466 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:46.003466 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:46.003466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:46.003466 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:46.003466 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:46.003466 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:46.005010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:46.005010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:46.005010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:46.005010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:46.005010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:46.005010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:46.005010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:46.005010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:46.005010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:46.005010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:46.005010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:46.005010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:46.005010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:46.005010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:46.005010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:46.005977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:46.005977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:46.005977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:46.005977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:46.005977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:46.005977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:46.005977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:46.005977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:46.005977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:46.007772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:46.007772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:46.007772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:46.007772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:46.007772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:46.007772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:46.007772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:46.007772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:46.007772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:46.007772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:46.007772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:46.007772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:46.007772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:46.007772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:40:46.007772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:40:46.007772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:46.008812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:46.009702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:46.009702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:46.009702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:46.238556 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:46.238875 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:46.239663 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:46.240116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:46.240962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:46.240962 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:46.240962 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:46.240962 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:46.240962 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:46.240962 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:46.240962 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:46.240962 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:46.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:46.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:46.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:46.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:46.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:46.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:46.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:46.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:46.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:46.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:46.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:46.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:46.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:46.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:46.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:46.242315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:46.243180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:46.243180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:46.243180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:46.243180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:46.243180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:46.243180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:46.243180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:46.243180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:46.243848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:46.243848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:46.243848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:46.243848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:46.243848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:46.243848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:46.243848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:46.243848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:46.243848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:46.243848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:46.243848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:46.243848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:46.243848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:46.243848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:40:46.243848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:40:46.243848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:46.244588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:46.245669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:46.245669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:46.272371 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:46.273005 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:46.273608 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:46.274012 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:46.274430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:46.274949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:46.274949 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:46.274949 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:46.274949 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:46.274949 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:46.274949 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:46.274949 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:46.274949 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:46.276584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:46.276584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:46.276584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:46.276584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:46.276584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:46.276584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:46.276584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:46.276584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:46.276584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:46.276584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:46.276584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:46.276584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:46.276584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:46.276584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:40:46.276584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:46.276584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:46.276584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:46.277210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:50.856450 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:50.858204 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:50.898343 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:50.920627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:50.920627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:40:50.920627 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:50.920627 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:50.920627 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:50.920627 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:50.920627 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:50.920627 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:50.920627 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:50.920627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:50.920627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:50.920627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:50.920627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:50.920627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:50.920627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:50.920627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:50.920627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:50.921618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:50.922722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:50.922722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:50.922722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:50.922722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:50.922722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:50.922722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:50.922722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:50.922722 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:50.922722 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:50.923204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:50.924072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:40:50.924072 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:50.924072 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:50.924072 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:50.924072 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:50.924072 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:50.924072 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:50.924072 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:50.926008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:50.926008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:50.926008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:50.926008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:50.926008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:50.926008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:50.926008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:50.926008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:50.926008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:50.926008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:50.926008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:50.926008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:50.926008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:50.926008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:40:50.926008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:50.926008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:50.926482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:51.001478 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:51.001964 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:40:51.002612 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:51.003024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:51.003871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:40:51.003871 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:51.003871 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:51.003871 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:51.003871 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:51.003871 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:51.003871 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:51.003871 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:51.004575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:51.004575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:51.004575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:51.004575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:51.004575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:51.004575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:51.004575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:51.004575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:51.004575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:51.004575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:51.004575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:51.004575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:51.004575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:51.004575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:51.004575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:51.005494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:51.005494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:51.005494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:51.005494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:51.005494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:51.005494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:51.005494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:51.005494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:51.005494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:51.005494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:51.005494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:51.005494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:51.005494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:51.005494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:51.005494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:51.006278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:51.007183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:51.007183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:51.007183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:51.007183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:51.007183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:51.007183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:51.007183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:51.007183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:51.007183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:51.007183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:51.007183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:51.007183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:51.007183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:51.239321 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:51.239929 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:51.241129 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:51.241129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:51.242056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:51.242056 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:51.242056 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:51.242056 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:51.242056 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:51.242056 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:51.242056 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:51.242056 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:51.243302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:51.243302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:51.243302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:51.243302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:51.243302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:51.243302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:51.243302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:51.243302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:51.243302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:51.243302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:51.243302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:51.243302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:51.243302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:51.243302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:51.243302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:51.243302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:51.244027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:51.244027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:51.244027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:51.244027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:51.244027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:51.244027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:51.244027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:51.244027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:51.244880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:51.244880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:51.244880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:51.244880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:51.244880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:51.244880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:51.244880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:51.244880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:51.244880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:51.244880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:51.244880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:51.244880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:51.244880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:51.244880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:40:51.244880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:40:51.244880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:51.245643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:51.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:51.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:51.273222 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:51.273656 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:51.274281 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:51.274682 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:51.274875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:51.275747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:51.275747 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:51.275747 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:51.275747 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:51.275747 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:51.275747 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:51.275747 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:51.275747 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:51.277306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:51.277306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:51.277306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:51.277306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:51.277306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:51.277306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:51.277306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:51.277306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:51.277306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:51.277306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:51.277306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:51.277306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:51.277306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:51.277306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:40:51.277306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:51.277306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:51.277306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:51.278091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:55.860809 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:55.860809 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:55.896705 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:55.897220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:55.898225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:40:55.898225 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:55.898225 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:55.898225 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:55.898225 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:55.898225 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:55.898225 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:55.898225 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:55.899308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:55.899308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:55.899308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:55.899308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:55.899308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:55.899308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:55.899308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:55.899308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:55.899308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:55.899308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:55.899308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:55.899308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:55.899308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:55.899308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:40:55.899308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:55.899308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:55.899308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:55.900006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:55.926140 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:55.926140 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:55.926140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:55.926140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:40:55.926140 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:55.926140 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:55.926140 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:55.926140 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:55.926140 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:55.926140 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:55.926140 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:55.926774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:55.926774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:55.926774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:55.926774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:55.926774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:55.926774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:55.926774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:55.926774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:55.926774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:55.926774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:55.926774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:55.926774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:55.926774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:55.926774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:40:55.926774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:55.926774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:55.927639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:56.002426 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:56.002907 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:40:56.003627 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:56.003930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:56.004911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:40:56.004911 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:56.004911 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:56.004911 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:56.004911 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:56.004911 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:56.004911 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:56.004911 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:56.006536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:56.006536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:56.006536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:56.006536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:56.006536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:56.006536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:56.006536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:56.006536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:56.006536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:56.006536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:56.006536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:56.006536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:56.006536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:56.006536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:56.006536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:56.008234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:56.008234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:56.008234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:56.008234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:56.008234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:56.008234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:56.008234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:56.008234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:56.008234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:56.008234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:56.008234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:56.008234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:56.008234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:56.008234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:56.008234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:56.009098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:56.011416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:56.011416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:56.011416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:56.011416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:56.011416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:56.011416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:56.011416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:56.011416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:56.011416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:56.011416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:56.011416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:56.011416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:56.011416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:56.240157 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:56.240882 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:56.242167 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:56.242610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:56.243675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:56.243675 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:56.243675 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:56.243675 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:56.243675 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:56.243675 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:56.243675 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:56.243675 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:56.245136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:56.245136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:40:56.245136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:56.245136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:56.245136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:56.245136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:56.245136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:56.245136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:56.245136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:56.245136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:40:56.245136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:56.245136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:40:56.245136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:56.245136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:40:56.245136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:40:56.245136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:56.245846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:40:56.245846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:56.245846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:40:56.245846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:40:56.245846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:56.245846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:40:56.245846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:56.245846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:40:56.246749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:56.246749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:56.246749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:56.246749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:56.246749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:56.246749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:56.246749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:56.246749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:56.246749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:56.246749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:56.246749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:56.246749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:56.246749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:56.246749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:40:56.246749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:40:56.246749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:56.247439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:56.248334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:56.248334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:40:56.274154 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:40:56.274726 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:40:56.275552 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:56.276018 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:40:56.276220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:56.277167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:40:56.277167 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:56.277167 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:40:56.277167 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:40:56.277167 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:56.277167 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:40:56.277167 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:56.277167 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:40:56.278798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:56.278798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:40:56.278798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:40:56.278798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:40:56.278798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:40:56.278798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:40:56.278798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:56.278798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:40:56.278798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:40:56.278798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:40:56.278798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:40:56.278798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:40:56.278798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:40:56.278798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:40:56.278798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:40:56.278798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:56.278798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:40:56.279509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:00.857775 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:00.859861 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:00.896024 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:00.896442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:00.897575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:41:00.897575 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:00.897575 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:00.897575 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:00.897575 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:00.897575 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:00.897575 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:00.897575 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:00.898786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:00.898786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:00.898786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:00.898786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:00.898786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:00.898786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:00.898786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:00.898786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:00.898786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:00.898786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:00.898786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:00.898786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:00.898786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:00.898786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:41:00.898786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:00.898786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:00.898786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:00.899652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:00.922807 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:00.924155 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:00.924494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:00.925736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 19:41:00.925736 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:00.925736 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:00.925736 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:00.925736 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:00.925736 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:00.925736 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:00.925736 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:00.927945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:00.927945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:00.927945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:00.927945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:00.927945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:00.927945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:00.927945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:00.927945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:00.927945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:00.927945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:00.927945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:00.927945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:00.927945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:00.927945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:41:00.927945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:00.927945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:00.928434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:01.003095 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:01.003705 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:41:01.004536 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:01.004908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:01.005815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:41:01.005815 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:01.005815 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:01.005815 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:01.005815 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:01.005815 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:01.005815 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:01.005815 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:01.007037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:01.007037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:01.007037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:01.007037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:01.007037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:01.007037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:01.007037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:01.007037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:01.007037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:01.007037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:01.007037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:01.007037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:01.007037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:01.007037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:01.007037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:01.007736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:01.007736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:01.007736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:01.007736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:01.007736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:01.007736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:01.007736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:01.007736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:01.007736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:01.008650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:01.008650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:01.008650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:01.008650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:01.008650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:01.008650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:01.008650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:01.008650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:01.008650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:01.008650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:01.008650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:01.008650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:01.008650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:01.008650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:41:01.008650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:41:01.008650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:01.009388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:01.010282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:01.010282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:01.010282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:01.240811 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:01.241294 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:01.242098 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:01.242567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:01.243474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:01.243474 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:01.243474 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:01.243474 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:01.243474 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:01.243474 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:01.243474 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:01.243474 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:01.244714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:01.244714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:01.244714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:01.244714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:01.244714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:01.244714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:01.244714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:01.244714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:01.244714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:01.244714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:01.244714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:01.244714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:01.244714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:01.244714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:01.244714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:01.244714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:01.245725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:01.245725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:01.245725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:01.245725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:01.245725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:01.245725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:01.245725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:01.245725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:01.246342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:01.246342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:01.246342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:01.246342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:01.246342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:01.246342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:01.246342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:01.246342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:01.246342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:01.246342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:01.246342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:01.246342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:01.246342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:01.246342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:41:01.246342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:41:01.246342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:01.247396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:01.248512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:01.248512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:01.274690 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:01.275131 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:01.275915 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:01.276324 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:01.276522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:01.277404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:01.277404 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:01.277404 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:01.277404 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:01.277404 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:01.277404 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:01.277404 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:01.277404 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:01.278876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:01.278876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:01.278876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:01.278876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:01.278876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:01.278876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:01.278876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:01.278876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:01.278876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:01.278876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:01.278876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:01.278876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:01.278876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:01.278876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:41:01.278876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:01.278876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:01.278876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:01.279417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:05.858452 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:05.860133 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:05.923609 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:05.928848 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:05.929191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:05.931403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:41:05.931403 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:05.931403 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:05.931403 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:05.931403 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:05.931403 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:05.931403 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:05.931403 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:05.932047 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:05.934068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:05.934068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:05.934068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:05.934068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:05.934068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:05.934068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:05.934068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:05.934068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:05.934068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:05.934068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:05.934068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:05.934068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:05.934068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:05.934068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:41:05.934068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:05.934068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:05.934969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:05.935969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:05.935969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:41:05.935969 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:05.935969 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:05.935969 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:05.935969 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:05.935969 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:05.935969 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:05.935969 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:05.936555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:05.936555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:05.936555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:05.936555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:05.936555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:05.936555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:05.936555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:05.936555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:05.936555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:05.936555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:05.936555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:05.936555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:05.936555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:05.936555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:41:05.936555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:05.936555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:05.936555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:05.937412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:06.003861 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:06.004475 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:41:06.005515 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:06.005726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:06.006723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:41:06.006723 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:06.006723 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:06.006723 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:06.006723 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:06.006723 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:06.006723 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:06.006723 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:06.008477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:06.008477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:06.008477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:06.008477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:06.008477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:06.008477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:06.008477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:06.008477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:06.008477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:06.008477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:06.008477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:06.008477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:06.008477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:06.008477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:06.008477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:06.009653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:06.009653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:06.009653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:06.009653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:06.009653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:06.009653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:06.009653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:06.009653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:06.009653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:06.010425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:06.010425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:06.010425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:06.010425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:06.010425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:06.010425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:06.010425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:06.010425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:06.010425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:06.010425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:06.010425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:06.010425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:06.010425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:06.010425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:41:06.010425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:41:06.010425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:06.011216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:06.011918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:06.011918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:06.011918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:06.241390 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:06.242118 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:06.242868 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:06.243394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:06.244382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:06.244382 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:06.244382 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:06.244382 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:06.244382 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:06.244382 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:06.244382 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:06.244382 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:06.246318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:06.246318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:06.246318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:06.246318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:06.246318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:06.246318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:06.246318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:06.246318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:06.246318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:06.246318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:06.246318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:06.246318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:06.246318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:06.246318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:06.246318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:06.246318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:06.247361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:06.247361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:06.247361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:06.247361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:06.247361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:06.247361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:06.247361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:06.247361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:06.248565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:06.248565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:06.248565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:06.248565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:06.248565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:06.248565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:06.248565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:06.248565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:06.248565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:06.248565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:06.248565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:06.248565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:06.248565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:06.248565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:41:06.248565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:41:06.248565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:06.249430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:06.250358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:06.250358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:06.275176 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:06.275569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:06.275910 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:06.276150 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:06.276245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:06.276725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:06.276725 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:06.276725 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:06.276725 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:06.276725 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:06.276725 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:06.276725 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:06.276725 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:06.277551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:06.277551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:06.277551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:06.277551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:06.277551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:06.277551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:06.277551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:06.277551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:06.277551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:06.277551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:06.277551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:06.277551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:06.277551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:06.277551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:41:06.277551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:06.277551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:06.277551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:06.278219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:07.979297 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=457da445-720a-41ec-add2-52ee9c320f3a, enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-6e977c5e-85a0-4398-b359-5ba638de167e', 'neutron:subnet_ids': '6de186a3-9e7c-4950-a1c6-817a37a68984 158905cc-b5be-42da-8777-3d7ded042b7c'}, gateway_chassis=[ae165a4b-f6c9-4bd5-841d-17adf770caee], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:18:2e:b1', name='lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8', networks=['172.24.5.89/24', '2001:db8::d/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=104575) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 07 19:41:10.438650 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=85c7f4ee-e2de-4589-bc99-20f6cc68c235, enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-40ad0605-2aac-4da1-b108-03821a0aa715', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-6e977c5e-85a0-4398-b359-5ba638de167e', 'neutron:subnet_ids': 'afc68917-6901-4e08-99ad-5c3d8bb8a584'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:48:ef:ba', name='lrp-017f3d96-e8ac-4d5d-888a-59a92ef1040b', networks=['192.168.24.1/24'], options={}, peer=[], status={}) old= {{(pid=104575) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 07 19:41:10.471485 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-40ad0605-2aac-4da1-b108-03821a0aa715 synchronized; highest priority chassis a385a967-b7ed-41c2-87ea-de89001246d0
Apr 07 19:41:10.472498 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-40ad0605-2aac-4da1-b108-03821a0aa715, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '40ad0605-2aac-4da1-b108-03821a0aa715', 'neutron:router_id': '6e977c5e-85a0-4398-b359-5ba638de167e'}}) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:10.473104 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-40ad0605-2aac-4da1-b108-03821a0aa715, chassis=a385a967-b7ed-41c2-87ea-de89001246d0, priority=1, columns={}) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:10.473519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:10.474226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:10.474226 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:10.474226 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:10.474226 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:10.474226 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:10.474226 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:10.474226 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:10.474226 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event Traceback (most recent call last):
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     match.run(event, row, updates)
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 86, in run
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.link_network_ha_chassis_group(
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2385, in link_network_ha_chassis_group
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     next(self.gen)
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     next(self.gen)
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     with self.create_transaction(
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     self.result = self.commit()
Apr 07 19:41:10.474916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Apr 07 19:41:10.475726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:10.475726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     raise result.ex
Apr 07 19:41:10.475726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:10.475726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Apr 07 19:41:10.475726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Apr 07 19:41:10.475726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:10.475726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Apr 07 19:41:10.475726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:10.475726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.event 
Apr 07 19:41:10.859786 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:10.861440 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:10.903566 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:10.903935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:10.904640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Traceback (most recent call last):
Apr 07 19:41:10.904640 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:10.904640 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:10.904640 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:10.904640 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:10.904640 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:10.904640 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:10.904640 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:10.905713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:10.905713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:10.905713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:10.905713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:10.905713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:10.905713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:10.905713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:10.905713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:10.905713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:10.905713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:10.905713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:10.905713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:10.905713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:10.905713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:41:10.905713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:10.905713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:10.905713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:10.906360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:10.927088 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:10.928009 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:10.928265 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:10.928471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:10.929239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:41:10.929239 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:10.929239 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:10.929239 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:10.929239 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:10.929239 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:10.929239 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:10.929239 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:10.930630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:10.930630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:10.930630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:10.930630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:10.930630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:10.930630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:10.930630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:10.930630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:10.930630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:10.930630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:10.930630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:10.930630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:10.930630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:10.930630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:41:10.930630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:10.930630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:10.931094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:11.004560 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:11.005160 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:41:11.005967 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:11.006318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:11.007279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:41:11.007279 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:11.007279 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:11.007279 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:11.007279 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:11.007279 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:11.007279 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:11.007279 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:11.008928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:11.008928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:11.008928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:11.008928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:11.008928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:11.008928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:11.008928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:11.008928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:11.008928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:11.008928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:11.008928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:11.008928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:11.008928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:11.008928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:11.008928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:11.009725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:11.009725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:11.009725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:11.009725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:11.009725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:11.009725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:11.009725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:11.009725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:11.009725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:11.010097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:11.010097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:11.010097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:11.010097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:11.010097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:11.010097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:11.010097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:11.010097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:11.010097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:11.010097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:11.010097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:11.010097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:11.010097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:11.010097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:41:11.010097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:41:11.010097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:11.010492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:11.011029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:11.011029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:11.011029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:11.242180 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:11.242685 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:11.243341 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:11.243728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:11.244664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:11.244664 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:11.244664 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:11.244664 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:11.244664 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:11.244664 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:11.244664 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:11.244664 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:11.245632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:11.245632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:11.245632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:11.245632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:11.245632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:11.245632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:11.245632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:11.245632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:11.245632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:11.245632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:11.245632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:11.245632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:11.245632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:11.245632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:11.245632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:11.245632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:11.246391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:11.246391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:11.246391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:11.246391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:11.246391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:11.246391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:11.246391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:11.246391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:11.246720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:11.246720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:11.246720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:11.246720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:11.246720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:11.246720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:11.246720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:11.246720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:11.246720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:11.246720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:11.246720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:11.246720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:11.246720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:11.246720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:41:11.246720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:41:11.246720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:11.247622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:11.248491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:11.248491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:11.275852 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:11.276356 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:11.276961 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:11.277381 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:11.277580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:11.278139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:11.278139 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:11.278139 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:11.278139 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:11.278139 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:11.278139 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:11.278139 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:11.278139 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:11.279424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:11.279424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:11.279424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:11.279424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:11.279424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:11.279424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:11.279424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:11.279424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:11.279424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:11.279424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:11.279424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:11.279424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:11.279424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:11.279424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:41:11.279424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:11.279424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:11.279424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:11.280419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:15.860391 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:15.861434 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:15.863080 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=321,neutron:UPDATE=1 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:41:15.911879 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:15.912373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:15.913432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Traceback (most recent call last):
Apr 07 19:41:15.913432 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:15.913432 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:15.913432 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:15.913432 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:15.913432 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:15.913432 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:15.913432 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:15.914975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:15.914975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:15.914975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:15.914975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:15.914975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:15.914975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:15.914975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:15.914975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:15.914975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:15.914975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:15.914975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:15.914975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:15.914975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:15.914975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:41:15.914975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:15.914975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:15.914975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:15.915806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:15.927637 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:15.928914 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:15.929038 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:15.929240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:15.930065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:41:15.930065 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:15.930065 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:15.930065 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:15.930065 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:15.930065 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:15.930065 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:15.930065 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:15.931759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:15.931759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:15.931759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:15.931759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:15.931759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:15.931759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:15.931759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:15.931759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:15.931759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:15.931759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:15.931759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:15.931759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:15.931759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:15.931759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:41:15.931759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:15.931759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:15.932727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:16.005315 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:16.005889 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:41:16.006405 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:16.006613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:16.007301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:41:16.007301 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:16.007301 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:16.007301 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:16.007301 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:16.007301 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:16.007301 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:16.007301 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:16.008560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:16.008560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:16.008560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:16.008560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:16.008560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:16.008560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:16.008560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:16.008560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:16.008560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:16.008560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:16.008560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:16.008560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:16.008560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:16.008560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:16.008560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:16.009300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:16.009300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:16.009300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:16.009300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:16.009300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:16.009300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:16.009300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:16.009300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:16.009300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:16.010123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:16.010123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:16.010123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:16.010123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:16.010123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:16.010123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:16.010123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:16.010123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:16.010123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:16.010123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:16.010123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:16.010123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:16.010123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:16.010123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:41:16.010123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:41:16.010123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:16.011016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:16.011887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:16.011887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:16.011887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:16.242686 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:16.243278 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:16.246010 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:16.246201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:16.246753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:16.246753 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:16.246753 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:16.246753 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:16.246753 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:16.246753 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:16.246753 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:16.246753 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:16.248148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:16.248148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:16.248148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:16.248148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:16.248148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:16.248148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:16.248148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:16.248148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:16.248148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:16.248148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:16.248148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:16.248148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:16.248148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:16.248148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:16.248148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:16.248148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:16.248878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:16.248878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:16.248878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:16.248878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:16.248878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:16.248878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:16.248878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:16.248878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:16.249783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:16.249783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:16.249783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:16.249783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:16.249783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:16.249783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:16.249783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:16.249783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:16.249783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:16.249783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:16.249783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:16.249783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:16.249783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:16.249783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:41:16.249783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:41:16.249783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:16.250674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:16.251603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:16.251603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:16.276276 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:16.276887 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:16.277393 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:16.277597 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:16.277701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:16.278285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:16.278285 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:16.278285 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:16.278285 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:16.278285 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:16.278285 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:16.278285 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:16.278285 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:16.279969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:16.279969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:16.279969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:16.279969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:16.279969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:16.279969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:16.279969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:16.279969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:16.279969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:16.279969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:16.279969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:16.279969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:16.279969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:16.279969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:41:16.279969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:16.279969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:16.279969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:16.280812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:20.861592 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:20.863228 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:20.901443 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:20.901876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:20.902775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Traceback (most recent call last):
Apr 07 19:41:20.902775 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:20.902775 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:20.902775 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:20.902775 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:20.902775 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:20.902775 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:20.902775 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:20.903772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:20.903772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:20.903772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:20.903772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:20.903772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:20.903772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:20.903772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:20.903772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:20.903772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:20.903772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:20.903772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:20.903772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:20.903772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:20.903772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:41:20.903772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:20.903772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:20.903772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:20.904597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:20.928604 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:20.929699 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:20.930269 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:20.930530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:20.931435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:41:20.931435 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:20.931435 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:20.931435 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:20.931435 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:20.931435 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:20.931435 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:20.931435 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:20.932625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:20.932625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:20.932625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:20.932625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:20.932625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:20.932625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:20.932625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:20.932625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:20.932625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:20.932625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:20.932625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:20.932625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:20.932625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:20.932625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:41:20.932625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:20.932625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:20.933705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:21.006363 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:21.006814 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:41:21.007488 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:21.007780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:21.008687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:41:21.008687 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:21.008687 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:21.008687 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:21.008687 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:21.008687 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:21.008687 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:21.008687 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:21.010157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:21.010157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:21.010157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:21.010157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:21.010157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:21.010157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:21.010157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:21.010157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:21.010157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:21.010157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:21.010157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:21.010157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:21.010157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:21.010157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:21.010157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:21.011155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:21.011155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:21.011155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:21.011155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:21.011155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:21.011155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:21.011155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:21.011155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:21.011155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:21.011791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:21.011791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:21.011791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:21.011791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:21.011791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:21.011791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:21.011791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:21.011791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:21.011791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:21.011791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:21.011791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:21.011791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:21.011791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:21.011791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:41:21.011791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:41:21.011791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:21.012672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:21.013608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:21.013608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:21.013608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:21.243309 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:21.243978 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:21.244395 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:21.244586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:21.245181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:21.245181 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:21.245181 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:21.245181 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:21.245181 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:21.245181 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:21.245181 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:21.245181 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:21.246705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:21.246705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:21.246705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:21.246705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:21.246705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:21.246705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:21.246705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:21.246705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:21.246705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:21.246705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:21.246705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:21.246705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:21.246705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:21.246705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:21.246705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:21.246705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:21.248015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:21.248015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:21.248015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:21.248015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:21.248015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:21.248015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:21.248015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:21.248015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:21.248954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:21.248954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:21.248954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:21.248954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:21.248954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:21.248954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:21.248954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:21.248954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:21.248954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:21.248954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:21.248954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:21.248954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:21.248954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:21.248954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:41:21.248954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:41:21.248954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:21.249812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:21.250347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:21.250347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:21.276791 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:21.277442 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:21.277946 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:21.278398 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:21.278642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:21.279351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:21.279351 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:21.279351 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:21.279351 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:21.279351 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:21.279351 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:21.279351 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:21.279351 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:21.281246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:21.281246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:21.281246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:21.281246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:21.281246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:21.281246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:21.281246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:21.281246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:21.281246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:21.281246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:21.281246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:21.281246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:21.281246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:21.281246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:41:21.281246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:21.281246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:21.281246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:21.282154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:25.862228 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:25.863790 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:25.902568 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:25.902874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:25.903699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Traceback (most recent call last):
Apr 07 19:41:25.903699 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:25.903699 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:25.903699 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:25.903699 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:25.903699 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:25.903699 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:25.903699 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:25.904944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:25.904944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:25.904944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:25.904944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:25.904944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:25.904944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:25.904944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:25.904944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:25.904944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:25.904944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:25.904944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:25.904944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:25.904944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:25.904944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:41:25.904944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:25.904944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:25.904944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:25.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:25.928905 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:25.930151 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:25.930393 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:25.930567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:25.931330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:41:25.931330 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:25.931330 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:25.931330 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:25.931330 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:25.931330 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:25.931330 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:25.931330 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:25.933061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:25.933061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:25.933061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:25.933061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:25.933061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:25.933061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:25.933061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:25.933061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:25.933061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:25.933061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:25.933061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:25.933061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:25.933061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:25.933061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:41:25.933061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:25.933061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:25.934072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:26.006788 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:26.007128 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:41:26.008099 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:26.008398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:26.009253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:41:26.009253 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:26.009253 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:26.009253 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:26.009253 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:26.009253 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:26.009253 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:26.009253 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:26.010547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:26.010547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:26.010547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:26.010547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:26.010547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:26.010547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:26.010547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:26.010547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:26.010547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:26.010547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:26.010547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:26.010547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:26.010547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:26.010547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:26.010547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:26.011309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:26.011309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:26.011309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:26.011309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:26.011309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:26.011309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:26.011309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:26.011309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:26.011309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:26.012233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:26.012233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:26.012233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:26.012233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:26.012233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:26.012233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:26.012233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:26.012233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:26.012233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:26.012233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:26.012233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:26.012233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:26.012233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:26.012233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:41:26.012233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:41:26.012233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:26.012932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:26.013717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:26.013717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:26.013717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:26.244044 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:26.244706 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:26.245561 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:26.246010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:26.246908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:26.246908 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:26.246908 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:26.246908 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:26.246908 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:26.246908 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:26.246908 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:26.246908 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:26.248240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:26.248240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:26.248240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:26.248240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:26.248240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:26.248240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:26.248240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:26.248240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:26.248240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:26.248240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:26.248240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:26.248240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:26.248240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:26.248240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:26.248240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:26.248240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:26.248967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:26.248967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:26.248967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:26.248967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:26.248967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:26.248967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:26.248967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:26.248967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:26.249810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:26.249810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:26.249810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:26.249810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:26.249810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:26.249810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:26.249810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:26.249810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:26.249810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:26.249810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:26.249810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:26.249810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:26.249810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:26.249810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:41:26.249810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:41:26.249810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:26.250559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:26.251584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:26.251584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:26.277313 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:26.277911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:26.278618 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:26.279012 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:26.279179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:26.279891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:26.279891 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:26.279891 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:26.279891 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:26.279891 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:26.279891 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:26.279891 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:26.279891 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:26.281677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:26.281677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:26.281677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:26.281677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:26.281677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:26.281677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:26.281677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:26.281677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:26.281677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:26.281677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:26.281677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:26.281677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:26.281677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:26.281677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:41:26.281677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:26.281677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:26.281677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:26.282745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:30.862850 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:30.864619 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:30.929452 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:30.930857 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:30.931204 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:30.931626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:30.932468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:41:30.932468 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:30.932468 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:30.932468 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:30.932468 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:30.932468 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:30.932468 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:30.932468 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:30.933859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:30.933859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:30.933859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:30.933859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:30.933859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:30.933859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:30.933859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:30.933859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:30.933859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:30.933859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:30.933859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:30.933859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:30.933859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:30.933859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:41:30.933859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:30.933859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:30.934595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:31.007720 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:31.012538 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:41:31.015372 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:31.016965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.019722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 19:41:31.019722 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:31.019722 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:31.019722 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:31.019722 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:31.019722 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:31.019722 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.019722 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:31.020868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.020868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:31.020868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:31.020868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:31.020868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:31.020868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:31.020868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:31.020868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:31.020868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:31.020868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:31.020868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:31.020868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:31.020868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:31.020868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:31.020868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:31.021428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:31.021428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:31.021428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:31.021428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:31.021428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:31.021428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:31.021428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:31.021428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.021428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:31.023341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.023341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:31.023341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:31.023341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:31.023341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:31.023341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:31.023341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:31.023341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:31.023341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:31.023341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:31.023341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:31.023341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:31.023341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:31.023341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:41:31.023341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:41:31.023341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:31.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:31.024326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:31.024326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.024326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:31.030302 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:31.030775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.031617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Traceback (most recent call last):
Apr 07 19:41:31.031617 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:31.031617 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:31.031617 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:31.031617 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:31.031617 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:31.031617 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.031617 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:31.032829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-73f2f24d-8d48-4e5f-8507-cd6d082dd411 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.032829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:31.032829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:31.032829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:31.032829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:31.032829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:31.032829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:31.032829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:31.032829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:31.032829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:31.032829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:31.032829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:31.032829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:31.032829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:41:31.032829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:31.032829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:31.032829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.033764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:31.244688 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:31.245212 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:31.246096 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:31.246398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.247005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:31.247005 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:31.247005 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:31.247005 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:31.247005 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:31.247005 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:31.247005 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.247005 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:31.248272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.248272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:31.248272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:31.248272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:31.248272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:31.248272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:31.248272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:31.248272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:31.248272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:31.248272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:31.248272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:31.248272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:31.248272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:31.248272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:31.248272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:31.248272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:31.248978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:31.248978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:31.248978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:31.248978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:31.248978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:31.248978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:31.248978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.248978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:31.249886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.249886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:31.249886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:31.249886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:31.249886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:31.249886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:31.249886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:31.249886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:31.249886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:31.249886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:31.249886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:31.249886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:31.249886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:31.249886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:41:31.249886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:41:31.249886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:31.250558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:31.251341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.251341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:31.278063 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:31.278646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:31.279411 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:31.279762 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:31.280001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.280789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:31.280789 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:31.280789 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:31.280789 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:31.280789 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:31.280789 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:31.280789 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.280789 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:31.282796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.282796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:31.282796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:31.282796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:31.282796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:31.282796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:31.282796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:31.282796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:31.282796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:31.282796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:31.282796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:31.282796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:31.282796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:31.282796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:41:31.282796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:31.282796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:31.282796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:31.283543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:35.863917 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:35.866187 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:35.903598 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:35.904162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:35.905263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:41:35.905263 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:35.905263 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:35.905263 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:35.905263 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:35.905263 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:35.905263 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:35.905263 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:35.906305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:35.906305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:35.906305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:35.906305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:35.906305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:35.906305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:35.906305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:35.906305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:35.906305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:35.906305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:35.906305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:35.906305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:35.906305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:35.906305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:41:35.906305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:35.906305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:35.906305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:35.907460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:35.930507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:35.931834 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:35.933211 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:35.933505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:35.934487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:41:35.934487 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:35.934487 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:35.934487 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:35.934487 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:35.934487 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:35.934487 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:35.934487 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:35.936087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:35.936087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:35.936087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:35.936087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:35.936087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:35.936087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:35.936087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:35.936087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:35.936087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:35.936087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:35.936087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:35.936087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:35.936087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:35.936087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:41:35.936087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:35.936087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:35.936741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:36.012401 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:36.013244 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:41:36.013831 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:36.014113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:36.014693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:36.014693 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:36.014693 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:36.014693 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:36.014693 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:36.014693 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:36.014693 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:36.014693 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:36.015820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:36.015820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:36.015820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:36.015820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:36.015820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:36.015820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:36.015820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:36.015820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:36.015820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:36.015820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:36.015820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:36.015820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:36.015820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:36.015820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:36.015820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:36.015820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:36.016760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:36.016760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:36.016760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:36.016760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:36.016760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:36.016760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:36.016760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:36.016760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:36.017405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:36.017405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:36.017405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:36.017405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:36.017405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:36.017405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:36.017405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:36.017405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:36.017405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:36.017405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:36.017405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:36.017405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:36.017405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:36.017405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:41:36.017405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:41:36.017405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:36.018010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:36.018972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:36.018972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:36.018972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:36.245568 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:36.245793 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:36.246450 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:36.246971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:36.248411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:36.248411 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:36.248411 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:36.248411 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:36.248411 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:36.248411 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:36.248411 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:36.248411 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:36.248698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:36.248698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:36.248698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:36.248698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:36.248698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:36.248698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:36.248698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:36.248698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:36.248698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:36.248698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:36.248698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:36.248698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:36.248698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:36.248698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:36.248698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:36.248698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:36.249269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:36.249269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:36.249269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:36.249269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:36.249269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:36.249269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:36.249269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:36.249269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:36.249768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:36.249768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:36.249768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:36.249768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:36.249768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:36.249768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:36.249768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:36.249768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:36.249768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:36.249768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:36.249768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:36.249768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:36.249768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:36.249768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:41:36.249768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:41:36.249768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:36.250359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:36.250974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:36.250974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:36.278893 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:36.279303 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:36.279593 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:36.279807 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:36.279904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:36.280276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:36.280276 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:36.280276 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:36.280276 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:36.280276 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:36.280276 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:36.280276 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:36.280276 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:36.281003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:36.281003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:36.281003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:36.281003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:36.281003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:36.281003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:36.281003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:36.281003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:36.281003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:36.281003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:36.281003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:36.281003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:36.281003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:36.281003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:41:36.281003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:36.281003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:36.281003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:36.282554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:40.867059 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:40.869706 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:40.909683 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:40.909938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:40.910790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:41:40.910790 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:40.910790 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:40.910790 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:40.910790 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:40.910790 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:40.910790 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:40.910790 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:40.912311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:40.912311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:40.912311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:40.912311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:40.912311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:40.912311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:40.912311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:40.912311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:40.912311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:40.912311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:40.912311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:40.912311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:40.912311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:40.912311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:41:40.912311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:40.912311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:40.912311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:40.912904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:40.931684 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:40.935532 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:40.935803 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:40.936259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:40.936715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:41:40.936715 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:40.936715 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:40.936715 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:40.936715 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:40.936715 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:40.936715 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:40.936715 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:40.937752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:40.937752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:40.937752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:40.937752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:40.937752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:40.937752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:40.937752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:40.937752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:40.937752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:40.937752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:40.937752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:40.937752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:40.937752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:40.937752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:41:40.937752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:40.937752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:40.938733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:41.013559 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:41.014074 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:41:41.014670 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:41.014867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:41.015568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:41.015568 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:41.015568 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:41.015568 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:41.015568 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:41.015568 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:41.015568 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:41.015568 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:41.016452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:41.016452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:41.016452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:41.016452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:41.016452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:41.016452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:41.016452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:41.016452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:41.016452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:41.016452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:41.016452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:41.016452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:41.016452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:41.016452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:41.016452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:41.016452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:41.018209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:41.018209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:41.018209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:41.018209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:41.018209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:41.018209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:41.018209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:41.018209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:41.018209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:41.018209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:41.018209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:41.018209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:41.018209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:41.018209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:41.018209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:41.018209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:41.018902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:41.019742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:41.019742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:41.019742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:41.019742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:41.019742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:41.019742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:41.019742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:41.019742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:41.019742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:41.019742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:41.019742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:41.246564 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:41.246929 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:41.247655 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:41.247828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:41.248469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:41.248469 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:41.248469 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:41.248469 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:41.248469 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:41.248469 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:41.248469 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:41.248469 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:41.249568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:41.249568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:41.249568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:41.249568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:41.249568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:41.249568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:41.249568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:41.249568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:41.249568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:41.249568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:41.249568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:41.249568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:41.249568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:41.249568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:41.249568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:41.249568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:41.250481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:41.250481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:41.250481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:41.250481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:41.250481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:41.250481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:41.250481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:41.250481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:41.250872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:41.250872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:41.250872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:41.250872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:41.250872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:41.250872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:41.250872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:41.250872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:41.250872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:41.250872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:41.250872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:41.250872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:41.250872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:41.250872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:41:41.250872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:41:41.250872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:41.251541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:41.252276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:41.252276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:41.279468 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:41.280025 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:41.280385 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:41.280653 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:41.280823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:41.285140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:41.285140 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:41.285140 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:41.285140 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:41.285140 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:41.285140 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:41.285140 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:41.285140 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:41.286218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:41.286218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:41.286218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:41.286218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:41.286218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:41.286218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:41.286218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:41.286218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:41.286218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:41.286218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:41.286218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:41.286218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:41.286218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:41.286218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:41:41.286218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:41.286218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:41.286218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:41.286959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:46.248120 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:46.248120 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:46.248120 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:46.248120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.248120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:41:46.248120 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:46.248120 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:46.248120 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:46.248120 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:46.248120 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:46.248120 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.248120 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:46.249838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.249838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:46.249838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:46.249838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:46.249838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:46.249838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:46.249838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:46.249838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:46.249838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:46.249838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:46.249838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:46.249838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:46.249838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:46.249838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:41:46.249838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:46.249838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:46.249838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.250854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:46.251443 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:46.251443 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:46.251443 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:46.251443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.251443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:41:46.251443 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:46.251443 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:46.251443 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:46.251443 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:46.251443 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:46.251443 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.251443 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:46.251839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.251839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:46.251839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:46.251839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:46.251839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:46.251839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:46.251839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:46.251839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:46.251839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:46.251839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:46.251839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:46.251839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:46.251839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:46.251839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:41:46.251839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:46.251839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.252382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:46.252961 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:46.252961 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:41:46.252961 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:46.252961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.252961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:46.252961 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:46.252961 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:46.252961 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:46.252961 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:46.252961 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:46.252961 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.252961 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:46.253401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.253401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:46.253401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:46.253401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:46.253401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:46.253401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:46.253401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:46.253401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:46.253401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:46.253401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:46.253401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:46.253401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:46.253401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:46.253401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:46.253401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:46.253401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:46.253923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:46.253923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:46.253923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:46.253923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:46.253923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:46.253923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:46.253923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.253923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:46.253923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.253923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:46.253923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:46.253923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:46.253923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:46.253923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:46.253923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:46.253923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:46.254424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:46.255023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:46.255023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:46.255023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:46.255023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:46.255023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:46.255023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:46.255023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:46.255023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:46.255023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:46.255023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.255023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:46.255023 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:46.255023 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:46.255447 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:46.255447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.255447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:46.255447 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:46.255447 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:46.255447 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:46.255447 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:46.255447 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:46.255447 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.255447 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:46.255447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.255447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:46.255447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:46.255447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:46.255447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:46.255447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:46.256083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:46.256083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:46.256083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:46.256083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:46.256083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:46.256083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:46.256083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:46.256083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:46.256083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:46.256083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:46.256083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:46.256083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:46.256083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:46.256083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:46.256083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:46.256083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:46.256555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.256555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:46.256555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.256555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:46.256555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:46.256555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:46.256555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:46.256555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:46.256555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:46.256555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:46.256555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:46.256555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:46.256555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:46.256555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:46.256555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:46.256555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:46.257075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:46.257660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:46.257660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:46.257660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.257660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:46.280015 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:46.280744 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:46.281263 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:46.281610 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:46.281856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.282496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:46.282496 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:46.282496 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:46.282496 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:46.282496 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:46.282496 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:46.282496 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.282496 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:46.283545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.283545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:46.283545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:46.283545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:46.283545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:46.283545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:46.283545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:46.283545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:46.283545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:46.283545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:46.283545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:46.283545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:46.283545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:46.283545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:41:46.283545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:46.283545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:46.283545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:46.284317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:50.868481 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:50.869875 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:50.895726 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:50.896134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:50.896907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:41:50.896907 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:50.896907 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:50.896907 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:50.896907 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:50.896907 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:50.896907 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:50.896907 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:50.897802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:50.897802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:50.897802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:50.897802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:50.897802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:50.897802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:50.897802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:50.897802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:50.897802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:50.897802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:50.897802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:50.897802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:50.897802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:50.897802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:41:50.897802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:50.897802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:50.897802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:50.898630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:50.933401 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:50.934494 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:50.934837 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:50.935101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:50.935961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:41:50.935961 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:50.935961 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:50.935961 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:50.935961 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:50.935961 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:50.935961 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:50.935961 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:50.936857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:50.936857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:50.936857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:50.936857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:50.936857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:50.936857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:50.936857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:50.936857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:50.936857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:50.936857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:50.936857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:50.936857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:50.936857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:50.936857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:41:50.936857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:50.936857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:50.937818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:52.324836 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:52.324836 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:41:52.324836 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:52.324836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:52.324836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:52.324836 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:52.324836 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:52.324836 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:52.324836 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:52.324836 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:52.324836 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:52.324836 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:52.325474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:52.325474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:52.325474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:52.325474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:52.325474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:52.325474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:52.325474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:52.325474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:52.325474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:52.325474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:52.325474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:52.325474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:52.325474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:52.325474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:52.325474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:52.325474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:52.325895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:52.325895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:52.325895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:52.325895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:52.325895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:52.325895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:52.325895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:52.325895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:52.325895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:52.325895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:52.325895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:52.325895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:52.325895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:52.325895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:52.325895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:52.325895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:52.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:52.326806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:52.326806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:52.326806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:52.326806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:52.326806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:52.326806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:52.326806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:52.326806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:52.326806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:52.326806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:52.326806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:52.326806 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:52.326806 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:52.327303 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:52.327303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:52.327303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:52.327303 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:52.327303 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:52.327303 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:52.327303 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:52.327303 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:52.327303 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:52.327303 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:52.327303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:52.327303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:52.327303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:52.327303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:52.327303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:52.327303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:52.327780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:52.327780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:52.327780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:52.327780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:52.327780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:52.327780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:52.327780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:52.327780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:52.327780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:52.327780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:52.327780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:52.327780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:52.327780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:52.327780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:52.327780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:52.327780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:52.328203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:52.328203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:52.328203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:52.328203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:52.328203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:52.328203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:52.328203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:52.328203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:52.328203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:52.328203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:52.328203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:52.328203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:52.328203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:52.328203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:52.328203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:52.328203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:52.328644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:52.329182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:52.329182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:52.329182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:52.329182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:52.329182 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:52.329182 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:52.329182 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:52.329182 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:52.329182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:52.329448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:52.330100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:52.330714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:52.330714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:52.330714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:52.330714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:55.869728 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:55.871400 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:55.905018 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:55.905436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:55.906397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:41:55.906397 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:55.906397 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:55.906397 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:55.906397 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:55.906397 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:55.906397 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:55.906397 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:55.908084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:55.908084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:55.908084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:55.908084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:55.908084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:55.908084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:55.908084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:55.908084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:55.908084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:55.908084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:55.908084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:55.908084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:55.908084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:55.908084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:41:55.908084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:55.908084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:55.908084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:55.908944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:55.934171 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:55.935160 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:55.935492 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:55.935719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:55.936775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:41:55.936775 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:55.936775 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:55.936775 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:55.936775 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:55.936775 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:55.936775 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:55.936775 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:55.938734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:55.938734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:55.938734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:55.938734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:55.938734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:55.938734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:55.938734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:55.938734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:55.938734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:55.938734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:55.938734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:55.938734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:55.938734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:55.938734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:41:55.938734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:55.938734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:55.939676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:56.016163 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:56.016662 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:41:56.017260 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:56.017567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:56.018354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:56.018354 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:56.018354 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:56.018354 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:56.018354 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:56.018354 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:56.018354 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:56.018354 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:56.019631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:56.019631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:56.019631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:56.019631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:56.019631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:56.019631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:56.019631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:56.019631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:56.019631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:56.019631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:56.019631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:56.019631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:56.019631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:56.019631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:56.019631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:56.019631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:56.020444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:56.020444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:56.020444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:56.020444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:56.020444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:56.020444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:56.020444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:56.020444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:56.021134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:56.021134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:56.021134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:56.021134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:56.021134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:56.021134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:56.021134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:56.021134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:56.021134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:56.021134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:56.021134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:56.021134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:56.021134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:56.021134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:41:56.021134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:41:56.021134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:56.021853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:56.022832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:56.022832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:56.022832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:56.249147 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:56.249752 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:56.250347 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:56.250748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:56.251577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:56.251577 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:56.251577 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:56.251577 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:56.251577 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:56.251577 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:56.251577 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:56.251577 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:56.252907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:56.252907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:41:56.252907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:56.252907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:56.252907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:56.252907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:56.252907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:56.252907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:56.252907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:56.252907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:41:56.252907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:56.252907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:41:56.252907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:56.252907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:41:56.252907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:41:56.252907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:56.253717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:41:56.253717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:56.253717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:41:56.253717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:41:56.253717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:56.253717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:41:56.253717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:56.253717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:41:56.254190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:56.254190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:56.254190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:56.254190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:56.254190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:56.254190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:56.254190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:56.254190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:56.254190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:56.254190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:56.254190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:56.254190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:56.254190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:56.254190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:41:56.254190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:41:56.254190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:56.255180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:56.256023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:56.256023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:41:56.281448 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:41:56.282130 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:41:56.282599 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:56.282929 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:41:56.283199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:56.283872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:41:56.283872 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:56.283872 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:41:56.283872 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:41:56.283872 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:56.283872 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:41:56.283872 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:56.283872 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:41:56.285754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:56.285754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:41:56.285754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:41:56.285754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:41:56.285754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:41:56.285754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:41:56.285754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:56.285754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:41:56.285754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:41:56.285754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:41:56.285754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:41:56.285754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:41:56.285754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:41:56.285754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:41:56.285754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:41:56.285754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:56.285754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:41:56.286617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:00.870259 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:00.871004 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:00.905959 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:00.906198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:00.906725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:42:00.906725 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:00.906725 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:00.906725 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:00.906725 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:00.906725 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:00.906725 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:00.906725 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:00.907788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:00.907788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:00.907788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:00.907788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:00.907788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:00.907788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:00.907788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:00.907788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:00.907788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:00.907788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:00.907788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:00.907788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:00.907788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:00.907788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:42:00.907788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:00.907788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:00.907788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:00.908612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:00.934662 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:00.935286 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:00.935507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:00.935631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:00.936208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:42:00.936208 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:00.936208 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:00.936208 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:00.936208 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:00.936208 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:00.936208 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:00.936208 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:00.937238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:00.937238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:00.937238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:00.937238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:00.937238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:00.937238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:00.937238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:00.937238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:00.937238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:00.937238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:00.937238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:00.937238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:00.937238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:00.937238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:42:00.937238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:00.937238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:00.938167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:01.016966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:01.017683 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:42:01.019816 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:01.020252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:01.021269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:01.021269 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:01.021269 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:01.021269 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:01.021269 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:01.021269 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:01.021269 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:01.021269 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:01.022540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:01.022540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:01.022540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:01.022540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:01.022540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:01.022540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:01.022540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:01.022540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:01.022540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:01.022540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:01.022540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:01.022540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:01.022540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:01.022540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:01.022540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:01.022540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:01.023262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:01.023262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:01.023262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:01.023262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:01.023262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:01.023262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:01.023262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:01.023262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:01.023946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:01.023946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:01.023946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:01.023946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:01.023946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:01.023946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:01.023946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:01.023946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:01.023946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:01.023946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:01.023946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:01.023946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:01.023946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:01.023946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:42:01.023946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:42:01.023946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:01.025492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:01.026491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:01.026491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:01.026491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:01.249876 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:01.250256 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:01.250688 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:01.250964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:01.252620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:01.252620 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:01.252620 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:01.252620 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:01.252620 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:01.252620 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:01.252620 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:01.252620 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:01.253503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:01.253503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:01.253503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:01.253503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:01.253503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:01.253503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:01.253503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:01.253503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:01.253503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:01.253503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:01.253503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:01.253503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:01.253503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:01.253503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:01.253503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:01.253503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:01.254329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:01.254329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:01.254329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:01.254329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:01.254329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:01.254329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:01.254329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:01.254329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:01.254718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:01.254718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:01.254718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:01.254718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:01.254718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:01.254718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:01.254718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:01.254718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:01.254718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:01.254718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:01.254718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:01.254718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:01.254718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:01.254718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:42:01.254718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:42:01.254718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:01.255539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:01.256211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:01.256211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:01.281941 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:01.282240 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:01.282835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:01.283292 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:01.283527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:01.285431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:01.285431 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:01.285431 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:01.285431 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:01.285431 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:01.285431 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:01.285431 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:01.285431 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:01.286551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:01.286551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:01.286551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:01.286551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:01.286551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:01.286551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:01.286551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:01.286551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:01.286551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:01.286551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:01.286551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:01.286551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:01.286551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:01.286551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:42:01.286551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:01.286551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:01.286551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:01.287598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:05.870804 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:05.872089 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:05.904950 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:05.905399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:05.906293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:42:05.906293 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:05.906293 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:05.906293 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:05.906293 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:05.906293 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:05.906293 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:05.906293 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:05.907507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:05.907507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:05.907507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:05.907507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:05.907507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:05.907507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:05.907507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:05.907507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:05.907507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:05.907507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:05.907507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:05.907507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:05.907507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:05.907507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:42:05.907507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:05.907507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:05.907507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:05.908457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:05.935397 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:05.937007 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:05.937234 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:05.937430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:05.938150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:42:05.938150 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:05.938150 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:05.938150 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:05.938150 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:05.938150 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:05.938150 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:05.938150 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:05.939327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:05.939327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:05.939327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:05.939327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:05.939327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:05.939327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:05.939327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:05.939327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:05.939327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:05.939327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:05.939327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:05.939327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:05.939327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:05.939327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:42:05.939327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:05.939327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:05.940255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:06.017819 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:06.018391 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:42:06.019090 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:06.019691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:06.020288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:06.020288 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:06.020288 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:06.020288 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:06.020288 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:06.020288 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:06.020288 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:06.020288 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:06.021327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:06.021327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:06.021327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:06.021327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:06.021327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:06.021327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:06.021327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:06.021327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:06.021327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:06.021327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:06.021327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:06.021327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:06.021327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:06.021327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:06.021327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:06.021327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:06.022601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:06.022601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:06.022601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:06.022601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:06.022601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:06.022601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:06.022601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:06.022601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:06.022601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:06.022601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:06.022601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:06.022601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:06.022601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:06.022601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:06.022601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:06.022601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:06.023745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:06.024658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:06.024658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:06.024658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:06.024658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:06.024658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:06.024658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:06.024658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:06.024658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:06.024658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:06.024658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:06.024658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:06.250714 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:06.251448 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:06.252011 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:06.252396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:06.253105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:06.253105 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:06.253105 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:06.253105 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:06.253105 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:06.253105 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:06.253105 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:06.253105 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:06.254120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:06.254120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:06.254120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:06.254120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:06.254120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:06.254120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:06.254120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:06.254120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:06.254120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:06.254120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:06.254120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:06.254120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:06.254120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:06.254120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:06.254120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:06.254120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:06.254697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:06.254697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:06.254697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:06.254697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:06.254697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:06.254697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:06.254697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:06.254697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:06.255453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:06.255453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:06.255453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:06.255453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:06.255453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:06.255453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:06.255453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:06.255453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:06.255453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:06.255453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:06.255453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:06.255453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:06.255453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:06.255453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:42:06.255453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:42:06.255453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:06.256163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:06.256889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:06.256889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:06.282489 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:06.283378 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:06.283962 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:06.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:06.284842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:06.285747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:06.285747 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:06.285747 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:06.285747 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:06.285747 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:06.285747 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:06.285747 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:06.285747 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:06.287526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:06.287526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:06.287526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:06.287526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:06.287526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:06.287526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:06.287526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:06.287526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:06.287526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:06.287526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:06.287526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:06.287526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:06.287526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:06.287526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:42:06.287526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:06.287526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:06.287526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:06.288417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:10.871418 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:10.876562 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:10.915148 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:10.915601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:10.916791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:42:10.916791 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:10.916791 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:10.916791 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:10.916791 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:10.916791 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:10.916791 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:10.916791 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:10.917527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:10.917527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:10.917527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:10.917527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:10.917527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:10.917527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:10.917527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:10.917527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:10.917527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:10.917527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:10.917527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:10.917527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:10.917527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:10.917527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:42:10.917527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:10.917527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:10.917527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:10.918460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:10.936280 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:10.937369 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:10.937661 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:10.937912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:10.938841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:42:10.938841 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:10.938841 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:10.938841 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:10.938841 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:10.938841 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:10.938841 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:10.938841 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:10.940273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:10.940273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:10.940273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:10.940273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:10.940273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:10.940273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:10.940273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:10.940273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:10.940273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:10.940273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:10.940273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:10.940273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:10.940273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:10.940273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:42:10.940273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:10.940273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:10.941212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:11.018779 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:11.019212 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:42:11.019958 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:11.020404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:11.021457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:11.021457 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:11.021457 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:11.021457 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:11.021457 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:11.021457 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:11.021457 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:11.021457 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:11.022924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:11.022924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:11.022924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:11.022924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:11.022924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:11.022924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:11.022924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:11.022924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:11.022924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:11.022924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:11.022924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:11.022924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:11.022924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:11.022924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:11.022924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:11.022924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:11.023410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:11.023410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:11.023410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:11.023410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:11.023410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:11.023410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:11.023410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:11.023410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:11.024915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:11.024915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:11.024915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:11.024915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:11.024915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:11.024915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:11.024915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:11.024915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:11.024915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:11.024915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:11.024915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:11.024915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:11.024915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:11.024915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:42:11.024915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:42:11.024915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:11.025391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:11.025904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:11.025904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:11.025904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:11.251725 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:11.252179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:11.252852 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:11.253332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:11.254306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:11.254306 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:11.254306 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:11.254306 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:11.254306 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:11.254306 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:11.254306 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:11.254306 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:11.255742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:11.255742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:11.255742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:11.255742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:11.255742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:11.255742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:11.255742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:11.255742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:11.255742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:11.255742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:11.255742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:11.255742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:11.255742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:11.255742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:11.255742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:11.255742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:11.256823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:11.256823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:11.256823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:11.256823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:11.256823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:11.256823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:11.256823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:11.256823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:11.257240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:11.257240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:11.257240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:11.257240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:11.257240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:11.257240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:11.257240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:11.257240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:11.257240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:11.257240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:11.257240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:11.257240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:11.257240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:11.257240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:42:11.257240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:42:11.257240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:11.257924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:11.258758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:11.258758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:11.283256 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:11.283806 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:11.284283 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:11.284738 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:11.285026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:11.285770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:11.285770 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:11.285770 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:11.285770 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:11.285770 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:11.285770 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:11.285770 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:11.285770 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:11.287482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:11.287482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:11.287482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:11.287482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:11.287482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:11.287482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:11.287482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:11.287482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:11.287482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:11.287482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:11.287482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:11.287482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:11.287482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:11.287482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:42:11.287482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:11.287482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:11.287482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:11.287921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:15.872670 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:15.873882 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:15.881712 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=241 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:42:15.908571 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:15.908747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:15.909357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:42:15.909357 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:15.909357 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:15.909357 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:15.909357 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:15.909357 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:15.909357 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:15.909357 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:15.910226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:15.910226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:15.910226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:15.910226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:15.910226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:15.910226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:15.910226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:15.910226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:15.910226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:15.910226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:15.910226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:15.910226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:15.910226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:15.910226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:42:15.910226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:15.910226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:15.910226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:15.911124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:15.936884 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:15.938235 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:15.938633 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:15.938924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:15.939920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:42:15.939920 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:15.939920 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:15.939920 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:15.939920 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:15.939920 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:15.939920 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:15.939920 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:15.941946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:15.941946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:15.941946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:15.941946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:15.941946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:15.941946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:15.941946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:15.941946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:15.941946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:15.941946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:15.941946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:15.941946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:15.941946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:15.941946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:42:15.941946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:15.941946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:15.942778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:16.019464 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:16.020037 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:42:16.020663 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:16.021021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:16.021850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:16.021850 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:16.021850 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:16.021850 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:16.021850 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:16.021850 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:16.021850 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:16.021850 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:16.023158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:16.023158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:16.023158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:16.023158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:16.023158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:16.023158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:16.023158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:16.023158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:16.023158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:16.023158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:16.023158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:16.023158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:16.023158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:16.023158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:16.023158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:16.023158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:16.023923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:16.023923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:16.023923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:16.023923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:16.023923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:16.023923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:16.023923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:16.023923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:16.024687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:16.024687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:16.024687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:16.024687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:16.024687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:16.024687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:16.024687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:16.024687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:16.024687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:16.024687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:16.024687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:16.024687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:16.024687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:16.024687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:42:16.024687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:42:16.024687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:16.025561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:16.026504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:16.026504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:16.026504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:16.252465 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:16.252838 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:16.253423 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:16.253948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:16.255015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:16.255015 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:16.255015 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:16.255015 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:16.255015 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:16.255015 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:16.255015 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:16.255015 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:16.256657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:16.256657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:16.256657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:16.256657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:16.256657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:16.256657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:16.256657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:16.256657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:16.256657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:16.256657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:16.256657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:16.256657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:16.256657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:16.256657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:16.256657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:16.256657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:16.257682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:16.257682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:16.257682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:16.257682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:16.257682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:16.257682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:16.257682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:16.257682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:16.258248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:16.258248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:16.258248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:16.258248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:16.258248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:16.258248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:16.258248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:16.258248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:16.258248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:16.258248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:16.258248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:16.258248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:16.258248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:16.258248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:42:16.258248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:42:16.258248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:16.259299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:16.260461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:16.260461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:16.283758 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:16.284138 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:16.284412 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:16.284751 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:16.284956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:16.285535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:16.285535 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:16.285535 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:16.285535 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:16.285535 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:16.285535 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:16.285535 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:16.285535 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:16.286670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:16.286670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:16.286670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:16.286670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:16.286670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:16.286670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:16.286670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:16.286670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:16.286670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:16.286670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:16.286670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:16.286670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:16.286670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:16.286670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:42:16.286670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:16.286670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:16.286670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:16.287601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:20.873752 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:20.876085 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:20.914575 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:20.915105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:20.916177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:42:20.916177 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:20.916177 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:20.916177 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:20.916177 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:20.916177 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:20.916177 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:20.916177 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:20.917145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:20.917145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:20.917145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:20.917145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:20.917145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:20.917145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:20.917145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:20.917145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:20.917145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:20.917145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:20.917145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:20.917145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:20.917145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:20.917145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:42:20.917145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:20.917145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:20.917145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:20.918018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:20.937477 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:20.938938 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:20.939491 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:20.939825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:20.941618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:42:20.941618 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:20.941618 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:20.941618 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:20.941618 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:20.941618 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:20.941618 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:20.941618 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:20.943807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:20.943807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:20.943807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:20.943807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:20.943807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:20.943807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:20.943807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:20.943807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:20.943807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:20.943807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:20.943807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:20.943807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:20.943807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:20.943807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:42:20.943807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:20.943807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:20.944289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:21.020044 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:21.020592 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:42:21.021340 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:21.021747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:21.022581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:21.022581 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:21.022581 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:21.022581 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:21.022581 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:21.022581 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:21.022581 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:21.022581 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:21.023592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:21.023592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:21.023592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:21.023592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:21.023592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:21.023592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:21.023592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:21.023592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:21.023592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:21.023592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:21.023592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:21.023592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:21.023592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:21.023592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:21.023592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:21.023592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:21.024170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:21.024170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:21.024170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:21.024170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:21.024170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:21.024170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:21.024170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:21.024170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:21.024580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:21.024580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:21.024580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:21.024580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:21.024580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:21.024580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:21.024580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:21.024580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:21.024580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:21.024580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:21.024580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:21.024580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:21.024580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:21.024580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:42:21.024580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:42:21.024580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:21.025141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:21.025694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:21.025694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:21.025694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:21.253474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:21.254218 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:21.255523 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:21.256040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:21.257109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:21.257109 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:21.257109 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:21.257109 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:21.257109 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:21.257109 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:21.257109 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:21.257109 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:21.258549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:21.258549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:21.258549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:21.258549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:21.258549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:21.258549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:21.258549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:21.258549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:21.258549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:21.258549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:21.258549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:21.258549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:21.258549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:21.258549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:21.258549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:21.258549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:21.259284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:21.259284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:21.259284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:21.259284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:21.259284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:21.259284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:21.259284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:21.259284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:21.260292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:21.260292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:21.260292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:21.260292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:21.260292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:21.260292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:21.260292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:21.260292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:21.260292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:21.260292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:21.260292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:21.260292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:21.260292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:21.260292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:42:21.260292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:42:21.260292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:21.260843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:21.261523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:21.261523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:21.284680 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:21.285452 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:21.286110 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:21.286497 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:21.286748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:21.287622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:21.287622 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:21.287622 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:21.287622 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:21.287622 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:21.287622 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:21.287622 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:21.287622 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:21.289397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:21.289397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:21.289397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:21.289397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:21.289397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:21.289397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:21.289397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:21.289397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:21.289397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:21.289397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:21.289397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:21.289397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:21.289397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:21.289397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:42:21.289397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:21.289397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:21.289397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:21.290262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:25.874550 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:25.876581 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:25.911171 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:25.911573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:25.912466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:42:25.912466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:25.912466 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:25.912466 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:25.912466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:25.912466 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:25.912466 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:25.912466 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:25.913683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:25.913683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:25.913683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:25.913683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:25.913683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:25.913683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:25.913683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:25.913683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:25.913683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:25.913683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:25.913683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:25.913683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:25.913683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:25.913683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:42:25.913683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:25.913683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:25.913683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:25.914403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:25.938002 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:25.962518 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:25.962631 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:25.962748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:25.963705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:42:25.963705 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:25.963705 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:25.963705 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:25.963705 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:25.963705 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:25.963705 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:25.963705 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:25.965635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:25.965635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:25.965635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:25.965635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:25.965635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:25.965635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:25.965635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:25.965635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:25.965635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:25.965635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:25.965635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:25.965635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:25.965635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:25.965635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:42:25.965635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:25.965635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:25.965952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:26.020602 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:26.020967 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:42:26.021379 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:26.021602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:26.022102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:26.022102 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:26.022102 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:26.022102 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:26.022102 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:26.022102 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:26.022102 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:26.022102 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:26.023314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:26.023314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:26.023314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:26.023314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:26.023314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:26.023314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:26.023314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:26.023314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:26.023314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:26.023314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:26.023314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:26.023314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:26.023314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:26.023314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:26.023314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:26.023314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:26.024497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:26.024497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:26.024497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:26.024497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:26.024497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:26.024497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:26.024497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:26.024497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:26.024895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:26.024895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:26.024895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:26.024895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:26.024895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:26.024895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:26.024895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:26.024895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:26.024895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:26.024895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:26.024895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:26.024895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:26.024895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:26.024895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:42:26.024895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:42:26.024895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:26.025697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:26.026373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:26.026373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:26.026373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:26.254171 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:26.254684 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:26.255483 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:26.256014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:26.256974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:26.256974 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:26.256974 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:26.256974 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:26.256974 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:26.256974 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:26.256974 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:26.256974 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:26.257888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:26.257888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:26.257888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:26.257888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:26.257888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:26.257888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:26.257888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:26.257888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:26.257888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:26.257888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:26.257888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:26.257888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:26.257888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:26.257888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:26.257888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:26.257888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:26.258607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:26.258607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:26.258607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:26.258607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:26.258607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:26.258607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:26.258607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:26.258607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:26.259310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:26.259310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:26.259310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:26.259310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:26.259310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:26.259310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:26.259310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:26.259310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:26.259310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:26.259310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:26.259310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:26.259310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:26.259310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:26.259310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:42:26.259310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:42:26.259310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:26.260006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:26.260963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:26.260963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:26.285450 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:26.285956 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:26.286521 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:26.286917 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:26.287203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:26.289222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:26.289222 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:26.289222 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:26.289222 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:26.289222 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:26.289222 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:26.289222 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:26.289222 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:26.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:26.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:26.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:26.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:26.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:26.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:26.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:26.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:26.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:26.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:26.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:26.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:26.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:26.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:42:26.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:26.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:26.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:26.290591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:30.875569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:30.876930 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:30.908799 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:30.909271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:30.910173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:42:30.910173 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:30.910173 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:30.910173 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:30.910173 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:30.910173 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:30.910173 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:30.910173 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:30.911189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:30.911189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:30.911189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:30.911189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:30.911189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:30.911189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:30.911189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:30.911189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:30.911189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:30.911189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:30.911189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:30.911189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:30.911189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:30.911189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:42:30.911189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:30.911189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:30.911189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:30.912062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:30.939015 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:30.940177 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:30.940487 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:30.940721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:30.941601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:42:30.941601 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:30.941601 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:30.941601 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:30.941601 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:30.941601 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:30.941601 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:30.941601 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:30.942793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:30.942793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:30.942793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:30.942793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:30.942793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:30.942793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:30.942793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:30.942793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:30.942793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:30.942793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:30.942793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:30.942793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:30.942793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:30.942793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:42:30.942793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:30.942793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:30.943521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:31.021695 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:31.021695 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:42:31.022713 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:31.023141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:31.024831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:31.024831 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:31.024831 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:31.024831 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:31.024831 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:31.024831 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:31.024831 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:31.024831 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:31.026389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:31.026389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:31.026389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:31.026389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:31.026389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:31.026389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:31.026389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:31.026389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:31.026389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:31.026389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:31.026389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:31.026389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:31.026389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:31.026389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:31.026389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:31.026389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:31.027206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:31.027206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:31.027206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:31.027206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:31.027206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:31.027206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:31.027206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:31.027206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:31.028114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:31.028114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:31.028114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:31.028114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:31.028114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:31.028114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:31.028114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:31.028114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:31.028114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:31.028114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:31.028114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:31.028114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:31.028114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:31.028114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:42:31.028114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:42:31.028114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:31.028872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:31.029745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:31.029745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:31.029745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:31.254974 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:31.255590 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:31.256445 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:31.256875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:31.257741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:31.257741 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:31.257741 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:31.257741 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:31.257741 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:31.257741 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:31.257741 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:31.257741 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:31.259103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:31.259103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:31.259103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:31.259103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:31.259103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:31.259103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:31.259103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:31.259103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:31.259103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:31.259103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:31.259103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:31.259103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:31.259103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:31.259103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:31.259103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:31.259103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:31.260132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:31.260132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:31.260132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:31.260132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:31.260132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:31.260132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:31.260132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:31.260132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:31.261015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:31.261015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:31.261015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:31.261015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:31.261015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:31.261015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:31.261015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:31.261015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:31.261015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:31.261015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:31.261015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:31.261015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:31.261015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:31.261015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:42:31.261015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:42:31.261015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:31.261714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:31.262803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:31.262803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:31.286023 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:31.286700 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:31.287370 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:31.287856 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:31.288268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:31.289200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:31.289200 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:31.289200 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:31.289200 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:31.289200 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:31.289200 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:31.289200 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:31.289200 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:31.291106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:31.291106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:31.291106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:31.291106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:31.291106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:31.291106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:31.291106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:31.291106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:31.291106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:31.291106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:31.291106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:31.291106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:31.291106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:31.291106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:42:31.291106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:31.291106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:31.291106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:31.292184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:35.876292 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:35.877946 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:35.911273 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:35.911600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:35.912425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:42:35.912425 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:35.912425 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:35.912425 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:35.912425 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:35.912425 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:35.912425 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:35.912425 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:35.913616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:35.913616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:35.913616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:35.913616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:35.913616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:35.913616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:35.913616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:35.913616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:35.913616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:35.913616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:35.913616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:35.913616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:35.913616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:35.913616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:42:35.913616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:35.913616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:35.913616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:35.914444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:35.939553 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:35.941456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:35.941799 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:35.942089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:35.943141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:42:35.943141 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:35.943141 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:35.943141 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:35.943141 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:35.943141 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:35.943141 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:35.943141 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:35.945038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:35.945038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:35.945038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:35.945038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:35.945038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:35.945038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:35.945038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:35.945038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:35.945038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:35.945038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:35.945038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:35.945038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:35.945038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:35.945038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:42:35.945038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:35.945038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:35.945791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:36.021710 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:36.022322 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:42:36.023070 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:36.023320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:36.023999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:36.023999 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:36.023999 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:36.023999 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:36.023999 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:36.023999 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:36.023999 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:36.023999 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:36.025312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:36.025312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:36.025312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:36.025312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:36.025312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:36.025312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:36.025312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:36.025312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:36.025312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:36.025312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:36.025312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:36.025312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:36.025312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:36.025312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:36.025312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:36.025312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:36.025938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:36.025938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:36.025938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:36.025938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:36.025938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:36.025938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:36.025938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:36.025938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:36.026978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:36.026978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:36.026978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:36.026978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:36.026978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:36.026978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:36.026978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:36.026978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:36.026978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:36.026978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:36.026978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:36.026978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:36.026978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:36.026978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:42:36.026978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:42:36.026978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:36.027611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:36.028259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:36.028259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:36.028259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:36.255754 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:36.256139 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:36.256906 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:36.257448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:36.258491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:36.258491 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:36.258491 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:36.258491 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:36.258491 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:36.258491 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:36.258491 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:36.258491 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:36.260073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:36.260073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:36.260073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:36.260073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:36.260073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:36.260073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:36.260073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:36.260073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:36.260073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:36.260073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:36.260073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:36.260073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:36.260073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:36.260073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:36.260073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:36.260073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:36.260790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:36.260790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:36.260790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:36.260790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:36.260790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:36.260790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:36.260790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:36.260790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:36.262010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:36.262010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:36.262010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:36.262010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:36.262010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:36.262010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:36.262010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:36.262010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:36.262010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:36.262010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:36.262010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:36.262010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:36.262010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:36.262010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:42:36.262010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:42:36.262010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:36.262821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:36.263682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:36.263682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:36.286714 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:36.287303 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:36.287710 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:36.288097 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:36.288337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:36.289088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:36.289088 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:36.289088 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:36.289088 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:36.289088 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:36.289088 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:36.289088 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:36.289088 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:36.290673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:36.290673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:36.290673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:36.290673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:36.290673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:36.290673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:36.290673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:36.290673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:36.290673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:36.290673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:36.290673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:36.290673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:36.290673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:36.290673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:42:36.290673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:36.290673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:36.290673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:36.291646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:40.877022 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:40.879195 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:40.915419 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:40.915835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:40.916897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:42:40.916897 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:40.916897 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:40.916897 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:40.916897 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:40.916897 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:40.916897 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:40.916897 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:40.918140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:40.918140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:40.918140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:40.918140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:40.918140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:40.918140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:40.918140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:40.918140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:40.918140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:40.918140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:40.918140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:40.918140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:40.918140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:40.918140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:42:40.918140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:40.918140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:40.918140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:40.919123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:40.941102 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:40.942165 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:40.942474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:40.942695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:40.943613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:42:40.943613 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:40.943613 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:40.943613 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:40.943613 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:40.943613 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:40.943613 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:40.943613 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:40.945513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:40.945513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:40.945513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:40.945513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:40.945513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:40.945513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:40.945513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:40.945513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:40.945513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:40.945513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:40.945513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:40.945513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:40.945513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:40.945513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:42:40.945513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:40.945513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:40.946447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:41.022480 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:41.023065 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:42:41.023661 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:41.023963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:41.024756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:41.024756 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:41.024756 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:41.024756 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:41.024756 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:41.024756 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:41.024756 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:41.024756 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:41.026142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:41.026142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:41.026142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:41.026142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:41.026142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:41.026142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:41.026142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:41.026142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:41.026142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:41.026142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:41.026142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:41.026142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:41.026142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:41.026142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:41.026142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:41.026142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:41.026878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:41.026878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:41.026878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:41.026878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:41.026878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:41.026878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:41.026878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:41.026878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:41.027711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:41.027711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:41.027711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:41.027711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:41.027711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:41.027711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:41.027711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:41.027711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:41.027711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:41.027711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:41.027711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:41.027711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:41.027711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:41.027711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:42:41.027711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:42:41.027711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:41.028439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:41.029388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:41.029388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:41.029388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:41.256486 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:41.257124 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:41.257625 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:41.257907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:41.258535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:41.258535 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:41.258535 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:41.258535 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:41.258535 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:41.258535 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:41.258535 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:41.258535 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:41.259889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:41.259889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:41.259889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:41.259889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:41.259889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:41.259889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:41.259889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:41.259889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:41.259889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:41.259889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:41.259889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:41.259889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:41.259889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:41.259889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:41.259889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:41.259889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:41.260882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:41.260882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:41.260882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:41.260882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:41.260882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:41.260882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:41.260882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:41.260882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:41.261657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:41.261657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:41.261657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:41.261657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:41.261657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:41.261657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:41.261657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:41.261657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:41.261657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:41.261657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:41.261657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:41.261657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:41.261657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:41.261657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:42:41.261657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:42:41.261657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:41.262558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:41.263579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:41.263579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:41.287321 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:41.287755 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:41.288335 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:41.288789 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:41.289104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:41.289854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:41.289854 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:41.289854 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:41.289854 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:41.289854 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:41.289854 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:41.289854 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:41.289854 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:41.291478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:41.291478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:41.291478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:41.291478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:41.291478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:41.291478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:41.291478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:41.291478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:41.291478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:41.291478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:41.291478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:41.291478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:41.291478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:41.291478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:42:41.291478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:41.291478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:41.291478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:41.292412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:45.877733 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:45.879468 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:45.913961 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:45.914408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:45.915424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:42:45.915424 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:45.915424 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:45.915424 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:45.915424 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:45.915424 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:45.915424 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:45.915424 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:45.916578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:45.916578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:45.916578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:45.916578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:45.916578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:45.916578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:45.916578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:45.916578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:45.916578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:45.916578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:45.916578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:45.916578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:45.916578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:45.916578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:42:45.916578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:45.916578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:45.916578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:45.917443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:45.941715 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:45.943045 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:45.943284 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:45.943570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:45.944211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:42:45.944211 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:45.944211 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:45.944211 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:45.944211 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:45.944211 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:45.944211 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:45.944211 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:45.949014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:45.949014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:45.949014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:45.949014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:45.949014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:45.949014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:45.949014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:45.949014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:45.949014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:45.949014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:45.949014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:45.949014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:45.949014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:45.949014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:42:45.949014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:45.949014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:45.949605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:46.023166 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:46.023781 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:42:46.024351 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:46.024702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:46.025613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:46.025613 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:46.025613 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:46.025613 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:46.025613 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:46.025613 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:46.025613 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:46.025613 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:46.027176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:46.027176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:46.027176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:46.027176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:46.027176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:46.027176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:46.027176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:46.027176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:46.027176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:46.027176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:46.027176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:46.027176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:46.027176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:46.027176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:46.027176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:46.027176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:46.027695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:46.027695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:46.027695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:46.027695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:46.027695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:46.027695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:46.027695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:46.027695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:46.028961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:46.028961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:46.028961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:46.028961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:46.028961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:46.028961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:46.028961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:46.028961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:46.028961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:46.028961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:46.028961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:46.028961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:46.028961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:46.028961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:42:46.028961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:42:46.028961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:46.029431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:46.029880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:46.029880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:46.029880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:46.257291 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:46.257584 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:46.259280 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:46.259446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:46.259950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:46.259950 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:46.259950 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:46.259950 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:46.259950 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:46.259950 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:46.259950 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:46.259950 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:46.261409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:46.261409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:46.261409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:46.261409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:46.261409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:46.261409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:46.261409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:46.261409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:46.261409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:46.261409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:46.261409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:46.261409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:46.261409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:46.261409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:46.261409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:46.261409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:46.262339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:46.262339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:46.262339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:46.262339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:46.262339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:46.262339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:46.262339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:46.262339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:46.264070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:46.264070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:46.264070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:46.264070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:46.264070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:46.264070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:46.264070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:46.264070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:46.264070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:46.264070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:46.264070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:46.264070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:46.264070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:46.264070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:42:46.264070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:42:46.264070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:46.265110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:46.266460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:46.266460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:46.287823 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:46.288318 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:46.288592 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:46.288875 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:46.289029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:46.290085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:46.290085 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:46.290085 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:46.290085 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:46.290085 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:46.290085 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:46.290085 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:46.290085 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:46.290634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:46.290634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:46.290634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:46.290634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:46.290634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:46.290634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:46.290634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:46.290634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:46.290634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:46.290634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:46.290634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:46.290634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:46.290634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:46.290634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:42:46.290634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:46.290634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:46.290634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:46.291843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:50.878642 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:50.880380 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:50.923359 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:50.923730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:50.926641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:50.927107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:50.927521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:50.927521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:50.927521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:50.927521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:50.927521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:50.927521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:50.942427 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:50.943675 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:50.944466 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:50.944466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:50.945358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:42:50.945358 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:50.945358 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:50.945358 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:50.945358 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:50.945358 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:50.945358 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:50.945358 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:50.947167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:50.947167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:50.947167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:50.947167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:50.947167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:50.947167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:50.947167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:50.947167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:50.947167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:50.947167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:50.947167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:50.947167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:50.947167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:50.947167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:42:50.947167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:50.947167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:50.947665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:51.023768 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:51.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:42:51.027379 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:51.027557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:51.028092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:51.028092 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:51.028092 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:51.028092 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:51.028092 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:51.028092 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:51.028092 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:51.028092 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:51.029334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:51.029334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:51.029334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:51.029334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:51.029334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:51.029334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:51.029334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:51.029334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:51.029334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:51.029334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:51.029334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:51.029334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:51.029334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:51.029334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:51.029334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:51.029334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:51.030503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:51.030503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:51.030503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:51.030503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:51.030503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:51.030503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:51.030503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:51.030503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:51.030962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:51.030962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:51.030962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:51.030962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:51.030962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:51.030962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:51.030962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:51.030962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:51.030962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:51.030962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:51.030962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:51.030962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:51.030962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:51.030962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:42:51.030962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:42:51.030962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:51.031895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:51.032822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:51.032822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:51.032822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:51.257729 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:51.259469 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:51.260259 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:51.260576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:51.261245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:51.261245 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:51.261245 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:51.261245 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:51.261245 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:51.261245 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:51.261245 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:51.261245 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:51.262138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:51.262138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:51.262138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:51.262138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:51.262138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:51.262138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:51.262138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:51.262138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:51.262138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:51.262138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:51.262138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:51.262138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:51.262138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:51.262138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:51.262138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:51.262138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:51.263185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:51.263185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:51.263185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:51.263185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:51.263185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:51.263185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:51.263185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:51.263185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:51.264097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:51.264097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:51.264097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:51.264097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:51.264097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:51.264097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:51.264097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:51.264097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:51.264097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:51.264097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:51.264097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:51.264097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:51.264097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:51.264097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:42:51.264097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:42:51.264097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:51.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:51.266421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:51.266421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:51.288351 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:51.290402 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:51.291006 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:51.291247 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:51.291361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:51.291862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:51.291862 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:51.291862 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:51.291862 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:51.291862 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:51.291862 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:51.291862 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:51.291862 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:51.292720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:51.292720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:51.292720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:51.292720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:51.292720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:51.292720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:51.292720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:51.292720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:51.292720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:51.292720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:51.292720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:51.292720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:51.292720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:51.292720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:42:51.292720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:51.292720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:51.292720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:51.293586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:55.879516 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:55.882063 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:55.912613 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:55.913131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:55.914961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:55.915313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:55.915653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:55.915653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:55.915653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:55.915653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:55.915653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:55.915653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:55.943555 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:55.944127 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:55.944427 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:55.944659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:55.945570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:42:55.945570 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:55.945570 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:55.945570 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:55.945570 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:55.945570 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:55.945570 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:55.945570 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:55.946760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:55.946760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:55.946760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:55.946760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:55.946760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:55.946760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:55.946760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:55.946760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:55.946760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:55.946760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:55.946760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:55.946760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:55.946760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:55.946760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:42:55.946760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:55.946760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:55.947552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:56.024422 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:56.024963 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:42:56.025674 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:56.026007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:56.026891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:56.026891 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:56.026891 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:56.026891 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:56.026891 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:56.026891 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:56.026891 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:56.026891 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:56.028233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:56.028233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:56.028233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:56.028233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:56.028233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:56.028233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:56.028233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:56.028233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:56.028233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:56.028233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:56.028233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:56.028233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:56.028233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:56.028233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:56.028233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:56.028233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:56.029082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:56.029082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:56.029082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:56.029082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:56.029082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:56.029082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:56.029082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:56.029082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:56.030202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:56.030202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:56.030202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:56.030202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:56.030202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:56.030202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:56.030202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:56.030202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:56.030202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:56.030202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:56.030202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:56.030202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:56.030202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:56.030202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:42:56.030202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:42:56.030202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:56.031044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:56.032044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:56.032044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:56.032044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:56.259810 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:56.260358 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:56.260973 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:56.261314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:56.262145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:56.262145 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:56.262145 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:56.262145 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:56.262145 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:56.262145 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:56.262145 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:56.262145 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:56.263109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:56.263109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:42:56.263109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:56.263109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:56.263109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:56.263109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:56.263109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:56.263109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:56.263109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:56.263109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:42:56.263109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:56.263109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:42:56.263109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:56.263109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:42:56.263109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:42:56.263109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:56.263905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:42:56.263905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:56.263905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:42:56.263905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:42:56.263905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:56.263905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:42:56.263905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:56.263905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:42:56.264309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:56.264309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:56.264309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:56.264309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:56.264309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:56.264309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:56.264309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:56.264309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:56.264309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:56.264309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:56.264309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:56.264309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:56.264309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:56.264309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:42:56.264309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:42:56.264309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:56.265207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:56.266106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:56.266106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:42:56.290867 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:42:56.291857 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:42:56.292742 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:56.293240 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:42:56.293488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:56.294514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:42:56.294514 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:56.294514 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:42:56.294514 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:42:56.294514 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:56.294514 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:42:56.294514 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:56.294514 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:42:56.296355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:56.296355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:42:56.296355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:42:56.296355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:42:56.296355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:42:56.296355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:42:56.296355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:56.296355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:42:56.296355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:42:56.296355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:42:56.296355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:42:56.296355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:42:56.296355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:42:56.296355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:42:56.296355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:42:56.296355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:56.296355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:42:56.297445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:00.880508 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:00.882782 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:00.921531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:00.922028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:00.923317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:43:00.923317 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:00.923317 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:00.923317 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:00.923317 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:00.923317 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:00.923317 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:00.923317 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:00.924806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:00.924806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:00.924806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:00.924806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:00.924806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:00.924806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:00.924806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:00.924806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:00.924806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:00.924806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:00.924806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:00.924806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:00.924806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:00.924806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:43:00.924806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:00.924806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:00.924806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:00.926163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:00.943874 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:00.945239 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:00.945578 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:00.945809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:00.946872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:43:00.946872 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:00.946872 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:00.946872 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:00.946872 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:00.946872 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:00.946872 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:00.946872 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:00.948445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:00.948445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:00.948445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:00.948445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:00.948445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:00.948445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:00.948445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:00.948445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:00.948445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:00.948445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:00.948445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:00.948445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:00.948445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:00.948445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:43:00.948445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:00.948445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:00.949513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:01.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:01.026284 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:43:01.027100 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:01.027469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:01.028343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:01.028343 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:01.028343 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:01.028343 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:01.028343 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:01.028343 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:01.028343 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:01.028343 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:01.029531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:01.029531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:01.029531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:01.029531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:01.029531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:01.029531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:01.029531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:01.029531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:01.029531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:01.029531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:01.029531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:01.029531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:01.029531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:01.029531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:01.029531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:01.029531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:01.030272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:01.030272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:01.030272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:01.030272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:01.030272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:01.030272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:01.030272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:01.030272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:01.031146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:01.031146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:01.031146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:01.031146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:01.031146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:01.031146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:01.031146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:01.031146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:01.031146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:01.031146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:01.031146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:01.031146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:01.031146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:01.031146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:43:01.031146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:43:01.031146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:01.031833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:01.032635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:01.032635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:01.032635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:01.260518 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:01.261385 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:01.262025 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:01.262409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:01.263215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:01.263215 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:01.263215 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:01.263215 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:01.263215 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:01.263215 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:01.263215 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:01.263215 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:01.264900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:01.264900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:01.264900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:01.264900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:01.264900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:01.264900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:01.264900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:01.264900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:01.264900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:01.264900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:01.264900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:01.264900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:01.264900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:01.264900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:01.264900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:01.264900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:01.265951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:01.265951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:01.265951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:01.265951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:01.265951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:01.265951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:01.265951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:01.265951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:01.267419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:01.267419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:01.267419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:01.267419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:01.267419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:01.267419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:01.267419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:01.267419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:01.267419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:01.267419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:01.267419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:01.267419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:01.267419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:01.267419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:43:01.267419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:43:01.267419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:01.268553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:01.269728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:01.269728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:01.291742 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:01.292595 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:01.293253 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:01.293698 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:01.294001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:01.294976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:01.294976 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:01.294976 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:01.294976 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:01.294976 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:01.294976 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:01.294976 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:01.294976 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:01.297775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:01.297775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:01.297775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:01.297775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:01.297775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:01.297775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:01.297775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:01.297775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:01.297775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:01.297775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:01.297775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:01.297775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:01.297775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:01.297775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:43:01.297775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:01.297775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:01.297775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:01.298589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:05.881360 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:05.882858 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:05.918245 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:05.918699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:05.919805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:43:05.919805 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:05.919805 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:05.919805 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:05.919805 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:05.919805 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:05.919805 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:05.919805 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:05.921007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:05.921007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:05.921007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:05.921007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:05.921007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:05.921007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:05.921007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:05.921007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:05.921007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:05.921007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:05.921007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:05.921007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:05.921007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:05.921007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:43:05.921007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:05.921007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:05.921007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:05.921745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:05.944576 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:05.945975 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:05.946390 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:05.946643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:05.947611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:43:05.947611 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:05.947611 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:05.947611 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:05.947611 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:05.947611 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:05.947611 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:05.947611 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:05.948656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:05.948656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:05.948656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:05.948656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:05.948656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:05.948656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:05.948656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:05.948656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:05.948656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:05.948656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:05.948656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:05.948656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:05.948656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:05.948656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:43:05.948656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:05.948656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:05.949372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:06.026954 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:06.026954 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:43:06.027765 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:06.028160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:06.028974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:06.028974 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:06.028974 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:06.028974 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:06.028974 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:06.028974 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:06.028974 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:06.028974 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:06.031096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:06.031096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:06.031096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:06.031096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:06.031096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:06.031096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:06.031096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:06.031096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:06.031096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:06.031096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:06.031096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:06.031096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:06.031096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:06.031096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:06.031096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:06.031096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:06.032133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:06.032133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:06.032133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:06.032133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:06.032133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:06.032133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:06.032133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:06.032133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:06.033336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:06.033336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:06.033336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:06.033336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:06.033336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:06.033336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:06.033336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:06.033336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:06.033336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:06.033336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:06.033336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:06.033336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:06.033336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:06.033336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:43:06.033336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:43:06.033336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:06.033859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:06.034366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:06.034366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:06.034366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:06.261189 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:06.262106 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:06.262854 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:06.263422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:06.264659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:06.264659 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:06.264659 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:06.264659 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:06.264659 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:06.264659 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:06.264659 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:06.264659 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:06.266170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:06.266170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:06.266170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:06.266170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:06.266170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:06.266170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:06.266170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:06.266170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:06.266170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:06.266170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:06.266170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:06.266170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:06.266170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:06.266170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:06.266170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:06.266170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:06.266848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:06.266848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:06.266848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:06.266848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:06.266848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:06.266848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:06.266848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:06.266848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:06.267218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:06.267218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:06.267218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:06.267218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:06.267218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:06.267218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:06.267218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:06.267218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:06.267218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:06.267218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:06.267218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:06.267218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:06.267218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:06.267218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:43:06.267218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:43:06.267218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:06.267843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:06.268629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:06.268629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:06.292428 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:06.292818 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:06.293276 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:06.293629 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:06.293856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:06.294555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:06.294555 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:06.294555 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:06.294555 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:06.294555 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:06.294555 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:06.294555 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:06.294555 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:06.296007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:06.296007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:06.296007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:06.296007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:06.296007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:06.296007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:06.296007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:06.296007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:06.296007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:06.296007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:06.296007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:06.296007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:06.296007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:06.296007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:43:06.296007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:06.296007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:06.296007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:06.296759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:10.882021 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:10.883624 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:10.924027 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:10.924948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:10.924948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:43:10.924948 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:10.924948 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:10.924948 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:10.924948 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:10.924948 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:10.924948 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:10.924948 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:10.926259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:10.926259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:10.926259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:10.926259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:10.926259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:10.926259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:10.926259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:10.926259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:10.926259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:10.926259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:10.926259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:10.926259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:10.926259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:10.926259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:43:10.926259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:10.926259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:10.926259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:10.926974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:10.945443 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:10.946658 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:10.946979 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:10.947365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:10.948269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:43:10.948269 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:10.948269 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:10.948269 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:10.948269 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:10.948269 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:10.948269 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:10.948269 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:10.950287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:10.950287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:10.950287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:10.950287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:10.950287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:10.950287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:10.950287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:10.950287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:10.950287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:10.950287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:10.950287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:10.950287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:10.950287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:10.950287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:43:10.950287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:10.950287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:10.951034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:11.026755 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:11.027385 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:43:11.028111 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:11.028451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:11.029288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:11.029288 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:11.029288 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:11.029288 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:11.029288 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:11.029288 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:11.029288 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:11.029288 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:11.030645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:11.030645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:11.030645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:11.030645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:11.030645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:11.030645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:11.030645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:11.030645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:11.030645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:11.030645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:11.030645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:11.030645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:11.030645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:11.030645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:11.030645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:11.030645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:11.031469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:11.031469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:11.031469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:11.031469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:11.031469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:11.031469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:11.031469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:11.031469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:11.032274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:11.032274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:11.032274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:11.032274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:11.032274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:11.032274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:11.032274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:11.032274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:11.032274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:11.032274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:11.032274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:11.032274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:11.032274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:11.032274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:43:11.032274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:43:11.032274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:11.033058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:11.033880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:11.033880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:11.033880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:11.261889 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:11.262178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:11.262563 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:11.262755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:11.263542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:11.263542 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:11.263542 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:11.263542 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:11.263542 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:11.263542 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:11.263542 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:11.263542 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:11.264776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:11.264776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:11.264776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:11.264776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:11.264776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:11.264776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:11.264776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:11.264776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:11.264776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:11.264776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:11.264776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:11.264776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:11.264776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:11.264776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:11.264776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:11.264776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:11.265491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:11.265491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:11.265491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:11.265491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:11.265491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:11.265491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:11.265491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:11.265491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:11.266877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:11.266877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:11.266877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:11.266877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:11.266877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:11.266877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:11.266877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:11.266877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:11.266877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:11.266877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:11.266877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:11.266877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:11.266877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:11.266877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:43:11.266877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:43:11.266877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:11.267697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:11.268242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:11.268242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:11.293010 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:11.293567 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:11.294099 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:11.294516 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:11.294796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:11.295624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:11.295624 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:11.295624 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:11.295624 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:11.295624 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:11.295624 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:11.295624 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:11.295624 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:11.297305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:11.297305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:11.297305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:11.297305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:11.297305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:11.297305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:11.297305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:11.297305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:11.297305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:11.297305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:11.297305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:11.297305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:11.297305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:11.297305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:43:11.297305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:11.297305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:11.297305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:11.297793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:15.882852 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:15.884232 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:15.891960 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=240 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:43:15.919632 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:15.920118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:15.921467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:43:15.921467 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:15.921467 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:15.921467 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:15.921467 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:15.921467 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:15.921467 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:15.921467 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:15.921977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:15.921977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:15.921977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:15.921977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:15.921977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:15.921977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:15.921977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:15.921977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:15.921977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:15.921977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:15.921977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:15.921977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:15.921977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:15.921977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:43:15.921977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:15.921977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:15.921977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:15.922926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:15.946008 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:15.947132 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:15.947522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:15.947801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:15.948829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:43:15.948829 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:15.948829 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:15.948829 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:15.948829 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:15.948829 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:15.948829 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:15.948829 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:15.950607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:15.950607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:15.950607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:15.950607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:15.950607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:15.950607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:15.950607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:15.950607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:15.950607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:15.950607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:15.950607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:15.950607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:15.950607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:15.950607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:43:15.950607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:15.950607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:15.951440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:16.027454 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:16.028318 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:43:16.029217 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:16.029634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:16.030659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:16.030659 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:16.030659 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:16.030659 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:16.030659 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:16.030659 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:16.030659 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:16.030659 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:16.032221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:16.032221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:16.032221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:16.032221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:16.032221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:16.032221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:16.032221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:16.032221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:16.032221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:16.032221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:16.032221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:16.032221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:16.032221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:16.032221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:16.032221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:16.032221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:16.032918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:16.032918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:16.032918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:16.032918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:16.032918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:16.032918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:16.032918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:16.032918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:16.034308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:16.034308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:16.034308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:16.034308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:16.034308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:16.034308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:16.034308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:16.034308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:16.034308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:16.034308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:16.034308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:16.034308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:16.034308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:16.034308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:43:16.034308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:43:16.034308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:16.034853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:16.035386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:16.035386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:16.035386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:16.262560 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:16.263010 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:16.263505 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:16.263763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:16.264654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:16.264654 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:16.264654 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:16.264654 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:16.264654 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:16.264654 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:16.264654 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:16.264654 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:16.265952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:16.265952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:16.265952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:16.265952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:16.265952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:16.265952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:16.265952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:16.265952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:16.265952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:16.265952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:16.265952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:16.265952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:16.265952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:16.265952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:16.265952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:16.265952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:16.266937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:16.266937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:16.266937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:16.266937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:16.266937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:16.266937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:16.266937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:16.266937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:16.268174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:16.268174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:16.268174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:16.268174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:16.268174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:16.268174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:16.268174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:16.268174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:16.268174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:16.268174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:16.268174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:16.268174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:16.268174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:16.268174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:43:16.268174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:43:16.268174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:16.269075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:16.269724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:16.269724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:16.293545 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:16.294198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:16.294583 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:16.294804 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:16.294947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:16.295497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:16.295497 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:16.295497 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:16.295497 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:16.295497 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:16.295497 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:16.295497 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:16.295497 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:16.297376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:16.297376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:16.297376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:16.297376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:16.297376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:16.297376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:16.297376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:16.297376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:16.297376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:16.297376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:16.297376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:16.297376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:16.297376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:16.297376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:43:16.297376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:16.297376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:16.297376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:16.297874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:20.883561 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:20.885647 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:20.921524 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:20.921940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:20.923038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:43:20.923038 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:20.923038 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:20.923038 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:20.923038 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:20.923038 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:20.923038 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:20.923038 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:20.924060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:20.924060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:20.924060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:20.924060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:20.924060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:20.924060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:20.924060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:20.924060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:20.924060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:20.924060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:20.924060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:20.924060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:20.924060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:20.924060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:43:20.924060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:20.924060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:20.924060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:20.924895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:20.946728 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:20.948701 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:20.949010 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:20.949278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:20.950472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:43:20.950472 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:20.950472 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:20.950472 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:20.950472 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:20.950472 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:20.950472 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:20.950472 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:20.952250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:20.952250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:20.952250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:20.952250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:20.952250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:20.952250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:20.952250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:20.952250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:20.952250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:20.952250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:20.952250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:20.952250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:20.952250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:20.952250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:43:20.952250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:20.952250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:20.952697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:21.028150 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:21.028808 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:43:21.029725 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:21.030122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:21.030793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:21.030793 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:21.030793 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:21.030793 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:21.030793 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:21.030793 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:21.030793 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:21.030793 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:21.031586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:21.031586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:21.031586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:21.031586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:21.031586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:21.031586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:21.031586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:21.031586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:21.031586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:21.031586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:21.031586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:21.031586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:21.031586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:21.031586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:21.031586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:21.031586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:21.032509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:21.032509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:21.032509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:21.032509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:21.032509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:21.032509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:21.032509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:21.032509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:21.032952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:21.032952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:21.032952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:21.032952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:21.032952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:21.032952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:21.032952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:21.032952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:21.032952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:21.032952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:21.032952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:21.032952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:21.032952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:21.032952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:43:21.032952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:43:21.032952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:21.033722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:21.034661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:21.034661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:21.034661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:21.263319 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:21.264216 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:21.264946 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:21.265462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:21.266364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:21.266364 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:21.266364 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:21.266364 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:21.266364 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:21.266364 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:21.266364 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:21.266364 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:21.267518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:21.267518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:21.267518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:21.267518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:21.267518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:21.267518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:21.267518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:21.267518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:21.267518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:21.267518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:21.267518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:21.267518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:21.267518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:21.267518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:21.267518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:21.267518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:21.268592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:21.268592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:21.268592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:21.268592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:21.268592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:21.268592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:21.268592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:21.268592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:21.269340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:21.269340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:21.269340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:21.269340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:21.269340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:21.269340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:21.269340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:21.269340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:21.269340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:21.269340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:21.269340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:21.269340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:21.269340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:21.269340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:43:21.269340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:43:21.269340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:21.270337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:21.271508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:21.271508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:21.294174 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:21.294903 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:21.295621 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:21.296166 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:21.296423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:21.297281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:21.297281 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:21.297281 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:21.297281 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:21.297281 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:21.297281 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:21.297281 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:21.297281 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:21.299290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:21.299290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:21.299290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:21.299290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:21.299290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:21.299290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:21.299290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:21.299290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:21.299290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:21.299290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:21.299290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:21.299290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:21.299290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:21.299290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:43:21.299290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:21.299290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:21.299290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:21.299918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:25.884244 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:25.885761 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:25.918231 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:25.918505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:25.919045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:43:25.919045 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:25.919045 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:25.919045 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:25.919045 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:25.919045 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:25.919045 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:25.919045 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:25.920009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:25.920009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:25.920009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:25.920009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:25.920009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:25.920009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:25.920009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:25.920009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:25.920009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:25.920009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:25.920009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:25.920009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:25.920009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:25.920009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:43:25.920009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:25.920009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:25.920009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:25.921099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:25.950586 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:25.951581 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:25.951780 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:25.951948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:25.952843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:43:25.952843 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:25.952843 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:25.952843 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:25.952843 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:25.952843 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:25.952843 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:25.952843 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:25.953821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:25.953821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:25.953821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:25.953821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:25.953821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:25.953821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:25.953821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:25.953821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:25.953821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:25.953821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:25.953821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:25.953821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:25.953821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:25.953821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:43:25.953821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:25.953821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:25.954636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:26.028968 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:26.029497 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:43:26.032434 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:26.032713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:26.033332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:26.033332 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:26.033332 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:26.033332 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:26.033332 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:26.033332 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:26.033332 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:26.033332 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:26.033825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:26.033825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:26.033825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:26.033825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:26.033825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:26.033825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:26.033825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:26.033825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:26.033825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:26.033825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:26.033825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:26.033825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:26.033825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:26.033825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:26.033825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:26.033825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:26.034718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:26.034718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:26.034718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:26.034718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:26.034718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:26.034718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:26.034718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:26.034718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:26.034718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:26.034718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:26.034718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:26.034718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:26.034718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:26.034718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:26.034718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:26.034718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:26.035533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:26.036551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:26.036551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:26.036551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:26.036551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:26.036551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:26.036551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:26.036551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:26.036551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:26.036551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:26.036551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:26.036551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:26.264071 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:26.264551 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:26.265131 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:26.265424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:26.266030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:26.266030 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:26.266030 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:26.266030 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:26.266030 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:26.266030 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:26.266030 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:26.266030 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:26.266711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:26.266711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:26.266711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:26.266711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:26.266711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:26.266711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:26.266711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:26.266711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:26.266711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:26.266711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:26.266711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:26.266711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:26.266711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:26.266711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:26.266711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:26.266711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:26.267479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:26.267479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:26.267479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:26.267479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:26.267479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:26.267479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:26.267479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:26.267479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:26.268154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:26.268154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:26.268154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:26.268154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:26.268154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:26.268154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:26.268154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:26.268154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:26.268154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:26.268154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:26.268154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:26.268154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:26.268154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:26.268154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:43:26.268154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:43:26.268154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:26.268959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:26.269806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:26.269806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:26.294951 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:26.295618 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:26.296731 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:26.297150 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:26.297380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:26.298299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:26.298299 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:26.298299 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:26.298299 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:26.298299 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:26.298299 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:26.298299 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:26.298299 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:26.299900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:26.299900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:26.299900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:26.299900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:26.299900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:26.299900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:26.299900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:26.299900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:26.299900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:26.299900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:26.299900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:26.299900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:26.299900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:26.299900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:43:26.299900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:26.299900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:26.299900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:26.300495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:30.885961 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:30.886908 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:30.921136 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:30.921586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:30.922790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:43:30.922790 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:30.922790 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:30.922790 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:30.922790 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:30.922790 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:30.922790 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:30.922790 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:30.923853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:30.923853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:30.923853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:30.923853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:30.923853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:30.923853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:30.923853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:30.923853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:30.923853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:30.923853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:30.923853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:30.923853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:30.923853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:30.923853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:43:30.923853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:30.923853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:30.923853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:30.924735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:30.951257 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:30.952266 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:30.952588 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:30.952811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:30.953753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:43:30.953753 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:30.953753 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:30.953753 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:30.953753 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:30.953753 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:30.953753 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:30.953753 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:30.954659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:30.954659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:30.954659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:30.954659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:30.954659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:30.954659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:30.954659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:30.954659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:30.954659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:30.954659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:30.954659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:30.954659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:30.954659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:30.954659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:43:30.954659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:30.954659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:30.955358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:31.029565 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:31.030108 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:43:31.031156 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:31.031508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:31.032370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:31.032370 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:31.032370 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:31.032370 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:31.032370 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:31.032370 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:31.032370 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:31.032370 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:31.033715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:31.033715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:31.033715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:31.033715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:31.033715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:31.033715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:31.033715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:31.033715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:31.033715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:31.033715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:31.033715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:31.033715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:31.033715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:31.033715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:31.033715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:31.033715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:31.034478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:31.034478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:31.034478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:31.034478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:31.034478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:31.034478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:31.034478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:31.034478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:31.035466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:31.035466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:31.035466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:31.035466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:31.035466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:31.035466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:31.035466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:31.035466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:31.035466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:31.035466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:31.035466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:31.035466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:31.035466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:31.035466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:43:31.035466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:43:31.035466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:31.036875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:31.038586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:31.038586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:31.038586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:31.264891 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:31.265444 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:31.265948 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:31.266387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:31.267168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:31.267168 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:31.267168 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:31.267168 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:31.267168 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:31.267168 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:31.267168 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:31.267168 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:31.268263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:31.268263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:31.268263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:31.268263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:31.268263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:31.268263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:31.268263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:31.268263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:31.268263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:31.268263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:31.268263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:31.268263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:31.268263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:31.268263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:31.268263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:31.268263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:31.269472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:31.269472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:31.269472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:31.269472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:31.269472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:31.269472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:31.269472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:31.269472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:31.270064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:31.270064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:31.270064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:31.270064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:31.270064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:31.270064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:31.270064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:31.270064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:31.270064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:31.270064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:31.270064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:31.270064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:31.270064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:31.270064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:43:31.270064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:43:31.270064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:31.271121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:31.271946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:31.271946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:31.295587 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:31.296199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:31.296667 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:31.297247 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:31.297466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:31.298424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:31.298424 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:31.298424 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:31.298424 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:31.298424 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:31.298424 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:31.298424 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:31.298424 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:31.300124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:31.300124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:31.300124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:31.300124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:31.300124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:31.300124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:31.300124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:31.300124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:31.300124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:31.300124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:31.300124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:31.300124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:31.300124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:31.300124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:43:31.300124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:31.300124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:31.300124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:31.300856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:35.885657 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:35.887373 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:35.920476 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:35.920858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:35.921694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:43:35.921694 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:35.921694 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:35.921694 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:35.921694 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:35.921694 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:35.921694 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:35.921694 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:35.922831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:35.922831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:35.922831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:35.922831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:35.922831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:35.922831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:35.922831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:35.922831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:35.922831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:35.922831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:35.922831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:35.922831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:35.922831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:35.922831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:43:35.922831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:35.922831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:35.922831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:35.923319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:35.951804 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:35.953234 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:35.953610 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:35.953843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:35.955147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:43:35.955147 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:35.955147 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:35.955147 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:35.955147 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:35.955147 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:35.955147 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:35.955147 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:35.957330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:35.957330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:35.957330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:35.957330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:35.957330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:35.957330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:35.957330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:35.957330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:35.957330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:35.957330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:35.957330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:35.957330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:35.957330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:35.957330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:43:35.957330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:35.957330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:35.958116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:36.030363 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:36.030844 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:43:36.031933 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:36.032442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:36.033566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:36.033566 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:36.033566 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:36.033566 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:36.033566 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:36.033566 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:36.033566 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:36.033566 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:36.034350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:36.034350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:36.034350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:36.034350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:36.034350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:36.034350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:36.034350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:36.034350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:36.034350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:36.034350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:36.034350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:36.034350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:36.034350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:36.034350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:36.034350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:36.034350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:36.034883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:36.034883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:36.034883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:36.034883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:36.034883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:36.034883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:36.034883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:36.034883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:36.035382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:36.035382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:36.035382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:36.035382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:36.035382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:36.035382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:36.035382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:36.035382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:36.035382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:36.035382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:36.035382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:36.035382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:36.035382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:36.035382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:43:36.035382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:43:36.035382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:36.035851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:36.036446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:36.036446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:36.036446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:36.265589 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:36.266284 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:36.266851 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:36.267317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:36.268616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:36.268616 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:36.268616 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:36.268616 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:36.268616 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:36.268616 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:36.268616 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:36.268616 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:36.269954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:36.269954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:36.269954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:36.269954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:36.269954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:36.269954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:36.269954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:36.269954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:36.269954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:36.269954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:36.269954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:36.269954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:36.269954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:36.269954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:36.269954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:36.269954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:36.270706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:36.270706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:36.270706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:36.270706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:36.270706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:36.270706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:36.270706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:36.270706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:36.271809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:36.271809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:36.271809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:36.271809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:36.271809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:36.271809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:36.271809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:36.271809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:36.271809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:36.271809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:36.271809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:36.271809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:36.271809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:36.271809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:43:36.271809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:43:36.271809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:36.272587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:36.273450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:36.273450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:36.296070 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:36.296402 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:36.297468 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:36.297931 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:36.298222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:36.299311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:36.299311 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:36.299311 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:36.299311 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:36.299311 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:36.299311 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:36.299311 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:36.299311 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:36.301074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:36.301074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:36.301074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:36.301074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:36.301074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:36.301074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:36.301074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:36.301074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:36.301074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:36.301074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:36.301074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:36.301074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:36.301074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:36.301074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:43:36.301074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:36.301074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:36.301074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:36.301775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:40.886368 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:40.887633 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:40.926663 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:40.927228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:40.928336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:43:40.928336 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:40.928336 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:40.928336 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:40.928336 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:40.928336 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:40.928336 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:40.928336 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:40.929608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:40.929608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:40.929608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:40.929608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:40.929608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:40.929608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:40.929608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:40.929608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:40.929608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:40.929608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:40.929608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:40.929608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:40.929608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:40.929608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:43:40.929608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:40.929608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:40.929608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:40.930606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:40.952505 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:40.953508 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:40.953892 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:40.954181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:40.955037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:43:40.955037 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:40.955037 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:40.955037 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:40.955037 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:40.955037 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:40.955037 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:40.955037 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:40.956226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:40.956226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:40.956226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:40.956226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:40.956226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:40.956226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:40.956226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:40.956226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:40.956226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:40.956226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:40.956226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:40.956226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:40.956226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:40.956226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:43:40.956226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:40.956226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:40.957138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:41.030967 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:41.031363 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:43:41.031909 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:41.032327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:41.033342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:41.033342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:41.033342 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:41.033342 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:41.033342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:41.033342 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:41.033342 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:41.033342 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:41.034277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:41.034277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:41.034277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:41.034277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:41.034277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:41.034277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:41.034277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:41.034277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:41.034277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:41.034277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:41.034277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:41.034277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:41.034277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:41.034277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:41.034277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:41.034277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:41.035107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:41.035107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:41.035107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:41.035107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:41.035107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:41.035107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:41.035107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:41.035107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:41.035530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:41.035530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:41.035530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:41.035530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:41.035530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:41.035530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:41.035530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:41.035530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:41.035530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:41.035530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:41.035530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:41.035530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:41.035530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:41.035530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:43:41.035530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:43:41.035530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:41.037959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:41.038914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:41.038914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:41.038914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:41.266364 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:41.266757 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:41.267928 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:41.268504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:41.269590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:41.269590 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:41.269590 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:41.269590 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:41.269590 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:41.269590 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:41.269590 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:41.269590 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:41.271217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:41.271217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:41.271217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:41.271217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:41.271217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:41.271217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:41.271217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:41.271217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:41.271217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:41.271217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:41.271217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:41.271217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:41.271217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:41.271217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:41.271217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:41.271217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:41.272377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:41.272377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:41.272377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:41.272377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:41.272377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:41.272377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:41.272377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:41.272377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:41.273345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:41.273345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:41.273345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:41.273345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:41.273345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:41.273345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:41.273345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:41.273345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:41.273345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:41.273345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:41.273345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:41.273345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:41.273345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:41.273345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:43:41.273345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:43:41.273345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:41.273871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:41.274394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:41.274394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:41.296396 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:41.296690 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:41.297441 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:41.297917 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:41.298271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:41.299181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:41.299181 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:41.299181 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:41.299181 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:41.299181 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:41.299181 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:41.299181 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:41.299181 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:41.300882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:41.300882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:41.300882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:41.300882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:41.300882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:41.300882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:41.300882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:41.300882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:41.300882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:41.300882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:41.300882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:41.300882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:41.300882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:41.300882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:43:41.300882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:41.300882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:41.300882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:41.301490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:45.887101 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:45.888569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:45.925236 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:45.925644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:45.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:43:45.926591 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:45.926591 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:45.926591 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:45.926591 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:45.926591 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:45.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:45.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:45.927732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:45.927732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:45.927732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:45.927732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:45.927732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:45.927732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:45.927732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:45.927732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:45.927732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:45.927732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:45.927732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:45.927732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:45.927732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:45.927732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:43:45.927732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:45.927732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:45.927732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:45.928496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:45.953032 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:45.954619 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:45.954938 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:45.955195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:45.956224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:43:45.956224 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:45.956224 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:45.956224 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:45.956224 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:45.956224 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:45.956224 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:45.956224 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:45.958014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:45.958014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:45.958014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:45.958014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:45.958014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:45.958014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:45.958014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:45.958014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:45.958014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:45.958014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:45.958014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:45.958014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:45.958014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:45.958014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:43:45.958014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:45.958014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:45.958752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:46.031465 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:46.031816 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:43:46.032421 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:46.032729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:46.033524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:46.033524 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:46.033524 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:46.033524 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:46.033524 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:46.033524 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:46.033524 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:46.033524 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:46.034645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:46.034645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:46.034645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:46.034645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:46.034645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:46.034645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:46.034645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:46.034645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:46.034645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:46.034645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:46.034645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:46.034645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:46.034645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:46.034645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:46.034645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:46.034645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:46.035905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:46.035905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:46.035905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:46.035905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:46.035905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:46.035905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:46.035905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:46.035905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:46.035905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:46.035905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:46.035905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:46.035905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:46.035905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:46.035905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:46.035905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:46.035905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:46.036608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:46.037559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:46.037559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:46.037559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:46.037559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:46.037559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:46.037559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:46.037559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:46.037559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:46.037559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:46.037559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:46.037559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:46.267079 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:46.267440 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:46.268171 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:46.268560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:46.269325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:46.269325 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:46.269325 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:46.269325 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:46.269325 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:46.269325 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:46.269325 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:46.269325 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:46.270569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:46.270569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:46.270569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:46.270569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:46.270569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:46.270569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:46.270569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:46.270569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:46.270569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:46.270569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:46.270569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:46.270569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:46.270569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:46.270569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:46.270569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:46.270569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:46.272149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:46.272149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:46.272149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:46.272149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:46.272149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:46.272149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:46.272149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:46.272149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:46.272149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:46.272149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:46.272149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:46.272149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:46.272149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:46.272149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:46.272149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:46.272149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:46.273823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:46.275103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:46.275103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:46.275103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:46.275103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:46.275103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:46.275103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:46.275103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:46.275103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:46.275103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:46.296742 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:46.297140 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:46.297690 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:46.298199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:46.298488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:46.299349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:46.299349 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:46.299349 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:46.299349 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:46.299349 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:46.299349 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:46.299349 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:46.299349 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:46.300829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:46.300829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:46.300829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:46.300829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:46.300829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:46.300829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:46.300829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:46.300829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:46.300829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:46.300829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:46.300829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:46.300829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:46.300829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:46.300829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:43:46.300829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:46.300829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:46.300829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:46.301520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:50.887803 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:50.889533 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:50.924479 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:50.924854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:50.925708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:43:50.925708 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:50.925708 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:50.925708 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:50.925708 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:50.925708 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:50.925708 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:50.925708 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:50.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:50.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:50.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:50.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:50.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:50.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:50.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:50.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:50.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:50.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:50.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:50.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:50.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:50.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:43:50.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:50.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:50.926591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:50.927495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:50.953903 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:50.955412 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:50.955856 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:50.956353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:50.957551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:43:50.957551 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:50.957551 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:50.957551 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:50.957551 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:50.957551 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:50.957551 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:50.957551 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:50.959400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:50.959400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:50.959400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:50.959400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:50.959400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:50.959400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:50.959400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:50.959400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:50.959400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:50.959400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:50.959400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:50.959400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:50.959400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:50.959400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:43:50.959400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:50.959400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:50.960220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:51.032075 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:51.032548 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:43:51.033659 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:51.033961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:51.034858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:51.034858 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:51.034858 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:51.034858 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:51.034858 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:51.034858 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:51.034858 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:51.034858 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:51.036266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:51.036266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:51.036266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:51.036266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:51.036266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:51.036266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:51.036266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:51.036266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:51.036266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:51.036266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:51.036266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:51.036266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:51.036266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:51.036266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:51.036266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:51.036266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:51.037081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:51.037081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:51.037081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:51.037081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:51.037081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:51.037081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:51.037081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:51.037081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:51.037800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:51.037800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:51.037800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:51.037800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:51.037800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:51.037800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:51.037800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:51.037800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:51.037800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:51.037800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:51.037800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:51.037800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:51.037800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:51.037800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:43:51.037800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:43:51.037800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:51.038582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:51.039408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:51.039408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:51.039408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:51.268201 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:51.268716 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:51.269447 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:51.269912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:51.270845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:51.270845 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:51.270845 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:51.270845 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:51.270845 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:51.270845 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:51.270845 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:51.270845 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:51.272437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:51.272437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:51.272437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:51.272437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:51.272437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:51.272437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:51.272437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:51.272437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:51.272437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:51.272437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:51.272437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:51.272437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:51.272437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:51.272437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:51.272437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:51.272437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:51.273194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:51.273194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:51.273194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:51.273194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:51.273194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:51.273194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:51.273194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:51.273194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:51.274178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:51.274178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:51.274178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:51.274178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:51.274178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:51.274178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:51.274178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:51.274178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:51.274178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:51.274178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:51.274178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:51.274178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:51.274178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:51.274178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:43:51.274178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:43:51.274178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:51.274934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:51.275913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:51.275913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:51.297231 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:51.297902 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:51.298656 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:51.299172 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:51.299405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:51.300583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:51.300583 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:51.300583 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:51.300583 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:51.300583 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:51.300583 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:51.300583 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:51.300583 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:51.302487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:51.302487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:51.302487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:51.302487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:51.302487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:51.302487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:51.302487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:51.302487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:51.302487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:51.302487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:51.302487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:51.302487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:51.302487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:51.302487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:43:51.302487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:51.302487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:51.302487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:51.303512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:55.888646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:55.890410 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:55.929521 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:55.929947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:55.931086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:43:55.931086 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:55.931086 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:55.931086 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:55.931086 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:55.931086 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:55.931086 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:55.931086 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:55.932222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:55.932222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:55.932222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:55.932222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:55.932222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:55.932222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:55.932222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:55.932222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:55.932222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:55.932222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:55.932222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:55.932222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:55.932222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:55.932222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:43:55.932222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:55.932222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:55.932222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:55.933397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:55.954686 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:55.955669 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:55.956412 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:55.956412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:55.956819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:43:55.956819 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:55.956819 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:55.956819 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:55.956819 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:55.956819 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:55.956819 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:55.956819 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:55.957966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:55.957966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:55.957966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:55.957966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:55.957966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:55.957966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:55.957966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:55.957966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:55.957966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:55.957966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:55.957966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:55.957966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:55.957966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:55.957966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:43:55.957966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:55.957966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:55.958740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:56.032781 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:56.033288 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:43:56.034019 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:56.034414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:56.035261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:56.035261 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:56.035261 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:56.035261 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:56.035261 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:56.035261 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:56.035261 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:56.035261 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:56.036673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:56.036673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:56.036673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:56.036673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:56.036673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:56.036673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:56.036673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:56.036673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:56.036673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:56.036673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:56.036673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:56.036673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:56.036673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:56.036673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:56.036673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:56.036673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:56.037650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:56.037650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:56.037650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:56.037650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:56.037650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:56.037650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:56.037650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:56.037650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:56.038104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:56.038104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:56.038104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:56.038104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:56.038104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:56.038104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:56.038104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:56.038104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:56.038104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:56.038104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:56.038104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:56.038104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:56.038104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:56.038104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:43:56.038104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:43:56.038104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:56.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:56.039883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:56.039883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:56.039883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:56.268644 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:56.269353 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:56.270310 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:56.270768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:56.271667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:56.271667 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:56.271667 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:56.271667 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:56.271667 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:56.271667 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:56.271667 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:56.271667 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:56.272686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:56.272686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:43:56.272686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:56.272686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:56.272686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:56.272686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:56.272686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:56.272686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:56.272686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:56.272686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:43:56.272686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:56.272686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:43:56.272686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:56.272686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:43:56.272686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:43:56.272686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:56.273428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:43:56.273428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:56.273428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:43:56.273428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:43:56.273428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:56.273428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:43:56.273428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:56.273428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:43:56.273786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:56.273786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:56.273786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:56.273786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:56.273786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:56.273786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:56.273786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:56.273786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:56.273786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:56.273786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:56.273786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:56.273786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:56.273786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:56.273786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:43:56.273786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:43:56.273786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:56.274585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:56.275427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:56.275427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:43:56.297774 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:43:56.298220 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:43:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:56.299155 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:43:56.299368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:56.300218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:43:56.300218 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:56.300218 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:43:56.300218 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:43:56.300218 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:56.300218 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:43:56.300218 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:56.300218 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:43:56.302324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:56.302324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:43:56.302324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:43:56.302324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:43:56.302324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:43:56.302324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:43:56.302324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:56.302324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:43:56.302324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:43:56.302324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:43:56.302324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:43:56.302324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:43:56.302324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:43:56.302324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:43:56.302324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:43:56.302324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:56.302324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:43:56.303137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:00.907452 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:00.908850 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:00.938440 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:00.938783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:00.939672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:44:00.939672 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:00.939672 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:00.939672 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:00.939672 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:00.939672 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:00.939672 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:00.939672 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:00.940576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:00.940576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:00.940576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:00.940576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:00.940576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:00.940576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:00.940576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:00.940576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:00.940576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:00.940576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:00.940576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:00.940576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:00.940576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:00.940576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:44:00.940576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:00.940576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:00.940576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:00.941450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:00.955448 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:00.956384 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:00.956752 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:00.957049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:00.957884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:44:00.957884 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:00.957884 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:00.957884 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:00.957884 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:00.957884 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:00.957884 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:00.957884 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:00.959514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:00.959514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:00.959514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:00.959514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:00.959514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:00.959514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:00.959514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:00.959514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:00.959514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:00.959514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:00.959514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:00.959514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:00.959514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:00.959514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:44:00.959514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:00.959514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:00.960283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:01.033667 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:01.034283 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:44:01.034884 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:01.035370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:01.036129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:01.036129 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:01.036129 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:01.036129 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:01.036129 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:01.036129 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:01.036129 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:01.036129 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:01.037500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:01.037500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:01.037500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:01.037500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:01.037500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:01.037500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:01.037500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:01.037500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:01.037500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:01.037500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:01.037500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:01.037500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:01.037500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:01.037500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:01.037500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:01.037500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:01.038383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:01.038383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:01.038383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:01.038383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:01.038383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:01.038383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:01.038383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:01.038383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:01.039497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:01.039497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:01.039497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:01.039497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:01.039497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:01.039497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:01.039497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:01.039497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:01.039497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:01.039497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:01.039497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:01.039497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:01.039497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:01.039497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:44:01.039497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:44:01.039497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:01.040266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:01.041133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:01.041133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:01.041133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:01.269626 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:01.270381 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:01.271184 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:01.271633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:01.272568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:01.272568 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:01.272568 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:01.272568 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:01.272568 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:01.272568 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:01.272568 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:01.272568 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:01.273831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:01.273831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:01.273831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:01.273831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:01.273831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:01.273831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:01.273831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:01.273831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:01.273831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:01.273831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:01.273831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:01.273831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:01.273831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:01.273831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:01.273831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:01.273831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:01.274573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:01.274573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:01.274573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:01.274573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:01.274573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:01.274573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:01.274573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:01.274573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:01.275499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:01.275499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:01.275499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:01.275499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:01.275499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:01.275499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:01.275499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:01.275499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:01.275499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:01.275499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:01.275499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:01.275499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:01.275499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:01.275499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:44:01.275499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:44:01.275499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:01.276257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:01.277085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:01.277085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:01.298812 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:01.299398 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:01.299935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:01.300416 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:01.300751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:01.301578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:01.301578 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:01.301578 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:01.301578 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:01.301578 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:01.301578 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:01.301578 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:01.301578 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:01.303552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:01.303552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:01.303552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:01.303552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:01.303552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:01.303552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:01.303552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:01.303552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:01.303552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:01.303552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:01.303552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:01.303552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:01.303552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:01.303552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:44:01.303552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:01.303552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:01.303552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:01.304380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:05.908180 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:05.910131 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:05.944178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:05.944536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:05.945363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:44:05.945363 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:05.945363 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:05.945363 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:05.945363 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:05.945363 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:05.945363 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:05.945363 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:05.946704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:05.946704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:05.946704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:05.946704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:05.946704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:05.946704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:05.946704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:05.946704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:05.946704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:05.946704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:05.946704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:05.946704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:05.946704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:05.946704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:44:05.946704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:05.946704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:05.946704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:05.947543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:05.955977 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:05.957963 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:05.958323 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:05.958560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:05.959561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:44:05.959561 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:05.959561 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:05.959561 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:05.959561 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:05.959561 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:05.959561 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:05.959561 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:05.961168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:05.961168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:05.961168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:05.961168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:05.961168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:05.961168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:05.961168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:05.961168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:05.961168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:05.961168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:05.961168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:05.961168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:05.961168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:05.961168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:44:05.961168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:05.961168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:05.962368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:06.034440 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:06.035019 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:44:06.035797 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:06.036169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:06.037159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:06.037159 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:06.037159 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:06.037159 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:06.037159 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:06.037159 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:06.037159 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:06.037159 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:06.038293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:06.038293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:06.038293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:06.038293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:06.038293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:06.038293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:06.038293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:06.038293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:06.038293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:06.038293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:06.038293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:06.038293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:06.038293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:06.038293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:06.038293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:06.038293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:06.039069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:06.039069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:06.039069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:06.039069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:06.039069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:06.039069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:06.039069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:06.039069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:06.039401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:06.039401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:06.039401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:06.039401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:06.039401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:06.039401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:06.039401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:06.039401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:06.039401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:06.039401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:06.039401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:06.039401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:06.039401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:06.039401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:44:06.039401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:44:06.039401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:06.040042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:06.040963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:06.040963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:06.040963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:06.270314 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:06.271682 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:06.272553 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:06.272970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:06.273792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:06.273792 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:06.273792 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:06.273792 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:06.273792 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:06.273792 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:06.273792 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:06.273792 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:06.274692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:06.274692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:06.274692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:06.274692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:06.274692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:06.274692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:06.274692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:06.274692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:06.274692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:06.274692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:06.274692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:06.274692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:06.274692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:06.274692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:06.274692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:06.274692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:06.275560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:06.275560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:06.275560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:06.275560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:06.275560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:06.275560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:06.275560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:06.275560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:06.275950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:06.275950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:06.275950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:06.275950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:06.275950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:06.275950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:06.275950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:06.275950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:06.275950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:06.275950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:06.275950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:06.275950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:06.275950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:06.275950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:44:06.275950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:44:06.275950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:06.276759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:06.277332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:06.277332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:06.299558 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:06.300699 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:06.301217 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:06.301559 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:06.301793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:06.302531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:06.302531 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:06.302531 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:06.302531 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:06.302531 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:06.302531 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:06.302531 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:06.302531 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:06.304255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:06.304255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:06.304255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:06.304255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:06.304255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:06.304255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:06.304255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:06.304255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:06.304255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:06.304255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:06.304255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:06.304255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:06.304255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:06.304255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:44:06.304255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:06.304255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:06.304255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:06.305063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:10.909074 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:10.910927 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:10.949711 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:10.950168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:10.951106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:44:10.951106 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:10.951106 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:10.951106 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:10.951106 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:10.951106 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:10.951106 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:10.951106 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:10.952263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:10.952263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:10.952263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:10.952263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:10.952263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:10.952263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:10.952263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:10.952263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:10.952263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:10.952263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:10.952263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:10.952263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:10.952263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:10.952263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:44:10.952263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:10.952263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:10.952263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:10.953096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:10.957285 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:10.958144 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:10.958425 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:10.958622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:10.959451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:44:10.959451 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:10.959451 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:10.959451 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:10.959451 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:10.959451 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:10.959451 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:10.959451 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:10.960681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:10.960681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:10.960681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:10.960681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:10.960681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:10.960681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:10.960681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:10.960681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:10.960681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:10.960681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:10.960681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:10.960681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:10.960681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:10.960681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:44:10.960681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:10.960681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:10.961122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:11.035026 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:11.035527 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:44:11.036200 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:11.036510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:11.037304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:11.037304 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:11.037304 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:11.037304 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:11.037304 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:11.037304 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:11.037304 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:11.037304 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:11.038765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:11.038765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:11.038765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:11.038765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:11.038765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:11.038765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:11.038765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:11.038765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:11.038765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:11.038765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:11.038765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:11.038765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:11.038765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:11.038765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:11.038765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:11.038765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:11.039524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:11.039524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:11.039524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:11.039524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:11.039524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:11.039524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:11.039524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:11.039524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:11.040465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:11.040465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:11.040465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:11.040465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:11.040465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:11.040465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:11.040465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:11.040465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:11.040465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:11.040465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:11.040465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:11.040465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:11.040465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:11.040465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:44:11.040465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:44:11.040465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:11.041315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:11.042173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:11.042173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:11.042173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:11.270978 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:11.271379 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:11.272199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:11.272650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:11.273594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:11.273594 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:11.273594 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:11.273594 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:11.273594 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:11.273594 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:11.273594 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:11.273594 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:11.274944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:11.274944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:11.274944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:11.274944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:11.274944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:11.274944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:11.274944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:11.274944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:11.274944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:11.274944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:11.274944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:11.274944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:11.274944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:11.274944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:11.274944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:11.274944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:11.275417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:11.275417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:11.275417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:11.275417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:11.275417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:11.275417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:11.275417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:11.275417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:11.276651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:11.276651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:11.276651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:11.276651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:11.276651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:11.276651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:11.276651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:11.276651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:11.276651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:11.276651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:11.276651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:11.276651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:11.276651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:11.276651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:44:11.276651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:44:11.276651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:11.277237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:11.277747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:11.277747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:11.300837 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:11.301380 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:11.301914 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:11.302396 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:11.302677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:11.303514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:11.303514 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:11.303514 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:11.303514 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:11.303514 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:11.303514 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:11.303514 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:11.303514 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:11.305068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:11.305068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:11.305068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:11.305068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:11.305068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:11.305068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:11.305068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:11.305068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:11.305068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:11.305068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:11.305068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:11.305068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:11.305068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:11.305068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:44:11.305068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:11.305068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:11.305068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:11.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:15.909790 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:15.911467 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:15.913079 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=239 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:44:15.943071 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:15.943443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:15.944277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:44:15.944277 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:15.944277 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:15.944277 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:15.944277 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:15.944277 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:15.944277 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:15.944277 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:15.945154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:15.945154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:15.945154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:15.945154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:15.945154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:15.945154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:15.945154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:15.945154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:15.945154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:15.945154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:15.945154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:15.945154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:15.945154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:15.945154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:44:15.945154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:15.945154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:15.945154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:15.945896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:15.957775 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:15.958925 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:15.959299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:15.959526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:15.960442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:44:15.960442 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:15.960442 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:15.960442 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:15.960442 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:15.960442 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:15.960442 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:15.960442 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:15.962878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:15.962878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:15.962878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:15.962878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:15.962878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:15.962878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:15.962878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:15.962878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:15.962878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:15.962878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:15.962878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:15.962878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:15.962878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:15.962878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:44:15.962878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:15.962878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:15.964052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:16.035568 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:16.036019 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:44:16.036658 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:16.037003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:16.038570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:16.038570 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:16.038570 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:16.038570 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:16.038570 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:16.038570 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:16.038570 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:16.038570 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:16.039039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:16.039039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:16.039039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:16.039039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:16.039039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:16.039039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:16.039039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:16.039039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:16.039039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:16.039039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:16.039039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:16.039039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:16.039039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:16.039039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:16.039039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:16.039039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:16.039552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:16.039552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:16.039552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:16.039552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:16.039552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:16.039552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:16.039552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:16.039552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:16.040532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:16.040532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:16.040532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:16.040532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:16.040532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:16.040532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:16.040532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:16.040532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:16.040532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:16.040532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:16.040532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:16.040532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:16.040532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:16.040532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:44:16.040532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:44:16.040532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:16.041042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:16.041555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:16.041555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:16.041555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:16.271813 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:16.272277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:16.273018 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:16.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:16.274395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:16.274395 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:16.274395 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:16.274395 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:16.274395 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:16.274395 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:16.274395 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:16.274395 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:16.275820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:16.275820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:16.275820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:16.275820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:16.275820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:16.275820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:16.275820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:16.275820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:16.275820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:16.275820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:16.275820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:16.275820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:16.275820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:16.275820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:16.275820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:16.275820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:16.276307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:16.276307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:16.276307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:16.276307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:16.276307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:16.276307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:16.276307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:16.276307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:16.277548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:16.277548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:16.277548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:16.277548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:16.277548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:16.277548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:16.277548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:16.277548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:16.277548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:16.277548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:16.277548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:16.277548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:16.277548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:16.277548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:44:16.277548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:44:16.277548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:16.278394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:16.279157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:16.279157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:16.301560 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:16.302176 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:16.302827 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:16.303347 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:16.303939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:16.304853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:16.304853 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:16.304853 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:16.304853 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:16.304853 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:16.304853 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:16.304853 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:16.304853 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:16.306778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:16.306778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:16.306778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:16.306778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:16.306778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:16.306778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:16.306778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:16.306778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:16.306778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:16.306778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:16.306778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:16.306778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:16.306778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:16.306778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:44:16.306778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:16.306778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:16.306778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:16.307514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:20.910526 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:20.912488 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:20.952791 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:20.953428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:20.954822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:44:20.954822 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:20.954822 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:20.954822 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:20.954822 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:20.954822 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:20.954822 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:20.954822 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:20.956104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:20.956104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:20.956104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:20.956104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:20.956104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:20.956104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:20.956104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:20.956104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:20.956104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:20.956104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:20.956104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:20.956104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:20.956104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:20.956104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:44:20.956104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:20.956104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:20.956104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:20.956914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:20.958697 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:20.960012 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:20.960452 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:20.960778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:20.962015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:44:20.962015 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:20.962015 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:20.962015 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:20.962015 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:20.962015 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:20.962015 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:20.962015 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:20.964207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:20.964207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:20.964207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:20.964207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:20.964207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:20.964207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:20.964207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:20.964207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:20.964207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:20.964207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:20.964207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:20.964207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:20.964207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:20.964207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:44:20.964207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:20.964207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:20.964713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:21.036205 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:21.042005 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:44:21.042701 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:21.042969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:21.043965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:21.043965 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:21.043965 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:21.043965 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:21.043965 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:21.043965 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:21.043965 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:21.043965 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:21.045111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:21.045111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:21.045111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:21.045111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:21.045111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:21.045111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:21.045111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:21.045111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:21.045111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:21.045111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:21.045111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:21.045111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:21.045111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:21.045111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:21.045111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:21.045111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:21.080204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:21.080204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:21.080204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:21.080204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:21.080204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:21.080204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:21.080204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:21.080204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:21.080204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:21.080204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:21.080204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:21.080204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:21.080204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:21.080204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:21.080204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:21.080204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:21.081425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:21.082350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:21.082350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:21.082350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:21.082350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:21.082350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:21.082350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:21.082350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:21.082350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:21.082350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:21.082350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:21.082350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:21.272406 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:21.273229 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:21.274061 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:21.274549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:21.275608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:21.275608 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:21.275608 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:21.275608 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:21.275608 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:21.275608 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:21.275608 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:21.275608 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:21.277084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:21.277084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:21.277084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:21.277084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:21.277084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:21.277084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:21.277084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:21.277084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:21.277084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:21.277084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:21.277084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:21.277084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:21.277084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:21.277084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:21.277084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:21.277084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:21.277582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:21.277582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:21.277582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:21.277582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:21.277582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:21.277582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:21.277582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:21.277582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:21.278831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:21.278831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:21.278831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:21.278831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:21.278831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:21.278831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:21.278831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:21.278831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:21.278831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:21.278831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:21.278831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:21.278831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:21.278831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:21.278831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:44:21.278831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:44:21.278831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:21.279352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:21.279807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:21.279807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:21.302126 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:21.302950 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:21.303715 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:21.304208 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:21.304465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:21.305397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:21.305397 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:21.305397 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:21.305397 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:21.305397 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:21.305397 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:21.305397 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:21.305397 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:21.307478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:21.307478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:21.307478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:21.307478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:21.307478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:21.307478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:21.307478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:21.307478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:21.307478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:21.307478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:21.307478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:21.307478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:21.307478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:21.307478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:44:21.307478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:21.307478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:21.307478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:21.308280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:25.911347 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:25.912808 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:25.948850 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:25.949252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:25.949945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:44:25.949945 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:25.949945 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:25.949945 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:25.949945 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:25.949945 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:25.949945 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:25.949945 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:25.950828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:25.950828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:25.950828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:25.950828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:25.950828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:25.950828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:25.950828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:25.950828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:25.950828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:25.950828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:25.950828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:25.950828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:25.950828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:25.950828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:44:25.950828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:25.950828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:25.950828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:25.951265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:25.959153 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:25.960153 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:25.960345 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:25.960494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:25.961240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:44:25.961240 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:25.961240 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:25.961240 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:25.961240 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:25.961240 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:25.961240 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:25.961240 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:25.963303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:25.963303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:25.963303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:25.963303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:25.963303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:25.963303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:25.963303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:25.963303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:25.963303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:25.963303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:25.963303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:25.963303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:25.963303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:25.963303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:44:25.963303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:25.963303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:25.964201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:26.041956 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:26.042600 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:44:26.043327 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:26.043661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:26.044600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:44:26.044600 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:26.044600 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:26.044600 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:26.044600 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:26.044600 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:26.044600 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:26.044600 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:26.045973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:26.045973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:26.045973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:26.045973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:26.045973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:26.045973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:26.045973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:26.045973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:26.045973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:26.045973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:26.045973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:26.045973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:26.045973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:26.045973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:26.045973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:26.046420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:26.046420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:26.046420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:26.046420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:26.046420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:26.046420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:26.046420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:26.046420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:26.046420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:26.047485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:26.047485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:26.047485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:26.047485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:26.047485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:26.047485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:26.047485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:26.047485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:26.047485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:26.047485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:26.047485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:26.047485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:26.047485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:26.047485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:44:26.047485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:44:26.047485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:26.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:26.048791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:26.048791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:26.048791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:26.273295 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:26.274385 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:26.275760 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:26.276374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:26.277701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:26.277701 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:26.277701 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:26.277701 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:26.277701 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:26.277701 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:26.277701 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:26.277701 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:26.279460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:26.279460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:26.279460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:26.279460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:26.279460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:26.279460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:26.279460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:26.279460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:26.279460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:26.279460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:26.279460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:26.279460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:26.279460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:26.279460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:26.279460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:26.279460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:26.280190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:26.280190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:26.280190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:26.280190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:26.280190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:26.280190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:26.280190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:26.280190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:26.280604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:26.280604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:26.280604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:26.280604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:26.280604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:26.280604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:26.280604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:26.280604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:26.280604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:26.280604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:26.280604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:26.280604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:26.280604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:26.280604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:44:26.280604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:44:26.280604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:26.281098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:26.281626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:26.281626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:26.302703 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:26.303487 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:26.304531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:26.304862 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:26.305144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:26.306046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:26.306046 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:26.306046 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:26.306046 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:26.306046 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:26.306046 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:26.306046 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:26.306046 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:26.307857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:26.307857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:26.307857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:26.307857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:26.307857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:26.307857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:26.307857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:26.307857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:26.307857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:26.307857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:26.307857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:26.307857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:26.307857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:26.307857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:44:26.307857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:26.307857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:26.307857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:26.308692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:30.912042 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:30.913879 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:30.954500 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:30.955560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:30.956698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:44:30.956698 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:30.956698 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:30.956698 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:30.956698 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:30.956698 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:30.956698 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:30.956698 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:30.957978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:30.957978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:30.957978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:30.957978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:30.957978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:30.957978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:30.957978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:30.957978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:30.957978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:30.957978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:30.957978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:30.957978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:30.957978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:30.957978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:44:30.957978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:30.957978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:30.957978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:30.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:30.959836 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:30.960879 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:30.961241 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:30.961491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:30.962463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:44:30.962463 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:30.962463 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:30.962463 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:30.962463 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:30.962463 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:30.962463 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:30.962463 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:30.964275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:30.964275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:30.964275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:30.964275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:30.964275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:30.964275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:30.964275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:30.964275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:30.964275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:30.964275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:30.964275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:30.964275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:30.964275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:30.964275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:44:30.964275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:30.964275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:30.964723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:31.042490 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:31.043215 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:44:31.043872 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:31.044236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:31.045363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:44:31.045363 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:31.045363 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:31.045363 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:31.045363 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:31.045363 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:31.045363 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:31.045363 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:31.046509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:31.046509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:31.046509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:31.046509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:31.046509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:31.046509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:31.046509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:31.046509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:31.046509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:31.046509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:31.046509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:31.046509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:31.046509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:31.046509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:31.046509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:31.047530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:31.047530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:31.047530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:31.047530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:31.047530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:31.047530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:31.047530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:31.047530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:31.047530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:31.047530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:31.047530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:31.047530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:31.047530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:31.047530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:31.047530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:31.048291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:31.049228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:31.049228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:31.049228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:31.049228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:31.049228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:31.049228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:31.049228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:31.049228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:31.049228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:31.049228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:31.049228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:31.049228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:31.049228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:31.274213 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:31.274776 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:31.275661 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:31.276123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:31.276928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:31.276928 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:31.276928 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:31.276928 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:31.276928 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:31.276928 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:31.276928 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:31.276928 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:31.277798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:31.277798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:31.277798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:31.277798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:31.277798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:31.277798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:31.277798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:31.277798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:31.277798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:31.277798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:31.277798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:31.277798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:31.277798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:31.277798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:31.277798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:31.277798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:31.278899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:31.278899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:31.278899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:31.278899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:31.278899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:31.278899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:31.278899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:31.278899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:31.278899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:31.278899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:31.278899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:31.278899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:31.278899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:31.278899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:31.278899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:31.278899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:31.280078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:31.281379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:31.281379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:31.281379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:31.281379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:31.281379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:31.281379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:31.281379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:31.281379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:31.281379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:31.303173 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:31.303482 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:31.303966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:31.304404 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:31.304642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:31.305379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:31.305379 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:31.305379 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:31.305379 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:31.305379 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:31.305379 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:31.305379 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:31.305379 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:31.306515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:31.306515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:31.306515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:31.306515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:31.306515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:31.306515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:31.306515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:31.306515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:31.306515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:31.306515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:31.306515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:31.306515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:31.306515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:31.306515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:44:31.306515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:31.306515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:31.306515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:31.307336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:35.912697 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:35.914315 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:35.951083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:35.951381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:35.952140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:44:35.952140 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:35.952140 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:35.952140 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:35.952140 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:35.952140 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:35.952140 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:35.952140 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:35.953226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:35.953226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:35.953226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:35.953226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:35.953226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:35.953226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:35.953226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:35.953226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:35.953226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:35.953226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:35.953226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:35.953226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:35.953226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:35.953226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:44:35.953226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:35.953226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:35.953226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:35.954084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:35.960441 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:35.961590 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:35.961765 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:35.961858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:35.962556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:44:35.962556 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:35.962556 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:35.962556 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:35.962556 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:35.962556 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:35.962556 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:35.962556 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:35.964651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:35.964651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:35.964651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:35.964651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:35.964651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:35.964651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:35.964651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:35.964651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:35.964651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:35.964651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:35.964651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:35.964651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:35.964651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:35.964651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:44:35.964651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:35.964651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:35.965683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:36.043031 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:36.043466 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:44:36.044211 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:36.044431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:36.045260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:44:36.045260 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:36.045260 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:36.045260 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:36.045260 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:36.045260 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:36.045260 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:36.045260 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:36.046634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:36.046634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:36.046634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:36.046634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:36.046634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:36.046634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:36.046634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:36.046634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:36.046634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:36.046634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:36.046634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:36.046634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:36.046634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:36.046634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:36.046634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:36.047565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:36.047565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:36.047565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:36.047565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:36.047565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:36.047565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:36.047565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:36.047565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:36.047565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:36.048366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:36.048366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:36.048366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:36.048366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:36.048366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:36.048366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:36.048366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:36.048366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:36.048366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:36.048366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:36.048366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:36.048366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:36.048366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:36.048366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:44:36.048366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:44:36.048366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:36.049507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:36.050049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:36.050049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:36.050049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:36.274789 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:36.275359 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:36.276406 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:36.276962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:36.277789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:36.277789 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:36.277789 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:36.277789 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:36.277789 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:36.277789 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:36.277789 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:36.277789 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:36.279085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:36.279085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:36.279085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:36.279085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:36.279085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:36.279085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:36.279085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:36.279085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:36.279085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:36.279085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:36.279085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:36.279085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:36.279085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:36.279085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:36.279085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:36.279085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:36.279929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:36.279929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:36.279929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:36.279929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:36.279929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:36.279929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:36.279929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:36.279929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:36.280666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:36.280666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:36.280666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:36.280666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:36.280666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:36.280666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:36.280666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:36.280666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:36.280666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:36.280666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:36.280666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:36.280666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:36.280666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:36.280666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:44:36.280666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:44:36.280666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:36.281499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:36.282385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:36.282385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:36.303727 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:36.304153 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:36.304831 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:36.305358 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:36.305673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:36.306589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:36.306589 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:36.306589 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:36.306589 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:36.306589 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:36.306589 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:36.306589 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:36.306589 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:36.308245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:36.308245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:36.308245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:36.308245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:36.308245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:36.308245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:36.308245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:36.308245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:36.308245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:36.308245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:36.308245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:36.308245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:36.308245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:36.308245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:44:36.308245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:36.308245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:36.308245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:36.309017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:40.913442 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:40.914631 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:40.943975 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:40.944519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:40.946655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:40.947115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:40.947501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:40.947501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:40.947501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:40.947501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:40.947501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:40.947501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:40.961062 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:40.962535 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:40.963013 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:40.963374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:40.966254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:40.967770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:40.968600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:40.968600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:40.968600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:40.968600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:40.968600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:40.968600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:41.043553 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:41.044201 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:44:41.045097 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:41.045343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:41.046213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:44:41.046213 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:41.046213 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:41.046213 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:41.046213 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:41.046213 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:41.046213 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:41.046213 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:41.047796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:41.047796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:41.047796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:41.047796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:41.047796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:41.047796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:41.047796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:41.047796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:41.047796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:41.047796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:41.047796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:41.047796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:41.047796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:41.047796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:41.047796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:41.048925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:41.048925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:41.048925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:41.048925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:41.048925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:41.048925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:41.048925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:41.048925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:41.048925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:41.049445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:41.049445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:41.049445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:41.049445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:41.049445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:41.049445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:41.049445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:41.049445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:41.049445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:41.049445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:41.049445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:41.049445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:41.049445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:41.049445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:44:41.049445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:44:41.049445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:41.050413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:41.052380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:41.052380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:41.052380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:41.275476 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:41.276138 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:41.277420 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:41.278076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:41.279148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:41.279148 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:41.279148 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:41.279148 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:41.279148 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:41.279148 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:41.279148 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:41.279148 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:41.280715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:41.280715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:41.280715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:41.280715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:41.280715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:41.280715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:41.280715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:41.280715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:41.280715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:41.280715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:41.280715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:41.280715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:41.280715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:41.280715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:41.280715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:41.280715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:41.282105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:41.282105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:41.282105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:41.282105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:41.282105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:41.282105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:41.282105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:41.282105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:41.282601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:41.282601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:41.282601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:41.282601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:41.282601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:41.282601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:41.282601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:41.282601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:41.282601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:41.282601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:41.282601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:41.282601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:41.282601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:41.282601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:44:41.282601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:44:41.282601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:41.283533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:41.286090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:41.286090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:41.304331 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:41.304999 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:41.305797 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:41.306429 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:41.306671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:41.307531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:41.307531 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:41.307531 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:41.307531 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:41.307531 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:41.307531 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:41.307531 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:41.307531 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:41.309160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:41.309160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:41.309160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:41.309160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:41.309160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:41.309160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:41.309160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:41.309160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:41.309160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:41.309160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:41.309160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:41.309160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:41.309160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:41.309160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:44:41.309160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:41.309160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:41.309160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:41.309603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:45.914282 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:45.915668 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:45.953148 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:45.953568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:45.954486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:44:45.954486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:45.954486 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:45.954486 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:45.954486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:45.954486 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:45.954486 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:45.954486 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:45.955740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:45.955740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:45.955740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:45.955740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:45.955740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:45.955740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:45.955740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:45.955740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:45.955740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:45.955740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:45.955740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:45.955740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:45.955740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:45.955740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:44:45.955740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:45.955740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:45.955740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:45.956338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:45.961746 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:45.962721 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:45.963116 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:45.963412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:45.964185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:44:45.964185 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:45.964185 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:45.964185 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:45.964185 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:45.964185 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:45.964185 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:45.964185 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:45.965407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:45.965407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:45.965407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:45.965407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:45.965407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:45.965407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:45.965407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:45.965407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:45.965407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:45.965407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:45.965407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:45.965407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:45.965407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:45.965407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:44:45.965407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:45.965407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:45.966311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:46.044315 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:46.044873 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:44:46.045598 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:46.045893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:46.046794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:44:46.046794 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:46.046794 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:46.046794 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:46.046794 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:46.046794 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:46.046794 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:46.046794 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:46.048321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:46.048321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:46.048321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:46.048321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:46.048321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:46.048321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:46.048321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:46.048321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:46.048321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:46.048321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:46.048321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:46.048321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:46.048321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:46.048321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:46.048321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:46.049139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:46.049139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:46.049139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:46.049139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:46.049139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:46.049139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:46.049139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:46.049139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:46.049139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:46.050200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:46.050200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:46.050200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:46.050200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:46.050200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:46.050200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:46.050200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:46.050200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:46.050200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:46.050200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:46.050200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:46.050200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:46.050200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:46.050200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:44:46.050200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:44:46.050200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:46.051056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:46.051918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:46.051918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:46.051918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:46.276336 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:46.276881 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:46.277576 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:46.278146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:46.279171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:46.279171 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:46.279171 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:46.279171 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:46.279171 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:46.279171 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:46.279171 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:46.279171 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:46.280341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:46.280341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:46.280341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:46.280341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:46.280341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:46.280341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:46.280341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:46.280341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:46.280341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:46.280341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:46.280341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:46.280341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:46.280341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:46.280341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:46.280341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:46.280341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:46.281230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:46.281230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:46.281230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:46.281230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:46.281230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:46.281230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:46.281230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:46.281230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:46.282020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:46.282020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:46.282020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:46.282020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:46.282020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:46.282020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:46.282020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:46.282020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:46.282020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:46.282020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:46.282020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:46.282020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:46.282020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:46.282020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:44:46.282020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:44:46.282020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:46.282897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:46.283788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:46.283788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:46.304802 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:46.305292 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:46.306043 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:46.306465 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:46.306714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:46.307610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:46.307610 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:46.307610 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:46.307610 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:46.307610 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:46.307610 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:46.307610 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:46.307610 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:46.308611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:46.308611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:46.308611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:46.308611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:46.308611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:46.308611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:46.308611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:46.308611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:46.308611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:46.308611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:46.308611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:46.308611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:46.308611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:46.308611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:44:46.308611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:46.308611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:46.308611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:46.309159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:50.915154 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:50.916651 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:50.955609 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:50.956023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:50.956891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:44:50.956891 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:50.956891 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:50.956891 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:50.956891 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:50.956891 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:50.956891 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:50.956891 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:50.958172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:50.958172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:50.958172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:50.958172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:50.958172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:50.958172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:50.958172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:50.958172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:50.958172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:50.958172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:50.958172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:50.958172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:50.958172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:50.958172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:44:50.958172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:50.958172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:50.958172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:50.958919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:50.962262 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:50.963384 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:50.963748 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:50.964004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:50.964892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:44:50.964892 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:50.964892 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:50.964892 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:50.964892 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:50.964892 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:50.964892 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:50.964892 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:50.966638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:50.966638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:50.966638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:50.966638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:50.966638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:50.966638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:50.966638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:50.966638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:50.966638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:50.966638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:50.966638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:50.966638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:50.966638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:50.966638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:44:50.966638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:50.966638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:50.967119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:51.044821 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:51.045543 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:44:51.046187 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:51.046509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:51.047347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:44:51.047347 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:51.047347 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:51.047347 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:51.047347 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:51.047347 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:51.047347 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:51.047347 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:51.048745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:51.048745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:51.048745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:51.048745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:51.048745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:51.048745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:51.048745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:51.048745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:51.048745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:51.048745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:51.048745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:51.048745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:51.048745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:51.048745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:51.048745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:51.049842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:51.049842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:51.049842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:51.049842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:51.049842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:51.049842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:51.049842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:51.049842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:51.049842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:51.050778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:51.050778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:51.050778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:51.050778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:51.050778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:51.050778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:51.050778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:51.050778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:51.050778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:51.050778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:51.050778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:51.050778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:51.050778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:51.050778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:44:51.050778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:44:51.050778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:51.051614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:51.052563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:51.052563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:51.052563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:51.276862 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:51.277412 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:51.278237 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:51.278639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:51.279526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:51.279526 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:51.279526 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:51.279526 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:51.279526 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:51.279526 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:51.279526 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:51.279526 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:51.280805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:51.280805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:51.280805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:51.280805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:51.280805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:51.280805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:51.280805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:51.280805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:51.280805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:51.280805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:51.280805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:51.280805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:51.280805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:51.280805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:51.280805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:51.280805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:51.281555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:51.281555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:51.281555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:51.281555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:51.281555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:51.281555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:51.281555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:51.281555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:51.282435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:51.282435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:51.282435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:51.282435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:51.282435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:51.282435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:51.282435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:51.282435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:51.282435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:51.282435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:51.282435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:51.282435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:51.282435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:51.282435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:44:51.282435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:44:51.282435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:51.283168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:51.283980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:51.283980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:51.305223 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:51.305689 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:51.306259 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:51.306637 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:51.306856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:51.307702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:51.307702 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:51.307702 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:51.307702 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:51.307702 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:51.307702 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:51.307702 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:51.307702 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:51.309373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:51.309373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:51.309373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:51.309373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:51.309373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:51.309373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:51.309373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:51.309373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:51.309373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:51.309373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:51.309373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:51.309373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:51.309373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:51.309373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:44:51.309373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:51.309373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:51.309373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:51.309935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:55.915686 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:55.917351 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:55.955174 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:55.955647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:55.956434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:44:55.956434 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:55.956434 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:55.956434 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:55.956434 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:55.956434 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:55.956434 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:55.956434 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:55.957763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:55.957763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:55.957763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:55.957763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:55.957763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:55.957763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:55.957763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:55.957763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:55.957763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:55.957763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:55.957763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:55.957763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:55.957763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:55.957763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:44:55.957763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:55.957763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:55.957763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:55.958735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:55.962813 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:55.963835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:55.964165 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:55.964410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:55.965536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:44:55.965536 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:55.965536 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:55.965536 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:55.965536 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:55.965536 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:55.965536 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:55.965536 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:55.967834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:55.967834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:55.967834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:55.967834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:55.967834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:55.967834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:55.967834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:55.967834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:55.967834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:55.967834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:55.967834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:55.967834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:55.967834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:55.967834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:44:55.967834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:55.967834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:55.968711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:56.045358 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:56.045827 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:44:56.046485 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:56.046868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:56.047707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:44:56.047707 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:56.047707 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:56.047707 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:56.047707 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:56.047707 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:56.047707 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:56.047707 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:56.048503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:56.048503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:56.048503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:56.048503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:56.048503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:56.048503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:56.048503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:56.048503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:56.048503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:56.048503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:56.048503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:56.048503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:56.048503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:56.048503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:56.048503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:56.049132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:56.049132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:56.049132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:56.049132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:56.049132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:56.049132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:56.049132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:56.049132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:56.049132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:56.049476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:56.049476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:56.049476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:56.049476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:56.049476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:56.049476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:56.049476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:56.049476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:56.049476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:56.049476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:56.049476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:56.049476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:56.049476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:56.049476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:44:56.049476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:44:56.049476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:56.049926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:56.050464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:56.050464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:56.050464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:56.277519 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:56.278027 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:56.278967 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:56.279407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:56.280251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:56.280251 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:56.280251 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:56.280251 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:56.280251 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:56.280251 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:56.280251 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:56.280251 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:56.281680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:56.281680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:44:56.281680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:56.281680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:56.281680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:56.281680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:56.281680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:56.281680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:56.281680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:56.281680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:44:56.281680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:56.281680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:44:56.281680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:56.281680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:44:56.281680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:44:56.281680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:56.282480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:44:56.282480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:56.282480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:44:56.282480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:44:56.282480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:56.282480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:44:56.282480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:56.282480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:44:56.283705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:56.283705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:56.283705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:56.283705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:56.283705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:56.283705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:56.283705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:56.283705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:56.283705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:56.283705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:56.283705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:56.283705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:56.283705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:56.283705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:44:56.283705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:44:56.283705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:56.284498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:56.285094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:56.285094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:44:56.305739 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:44:56.306255 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:44:56.306816 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:56.307241 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:44:56.307455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:56.308210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:44:56.308210 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:56.308210 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:44:56.308210 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:44:56.308210 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:56.308210 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:44:56.308210 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:56.308210 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:44:56.310007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:56.310007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:44:56.310007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:44:56.310007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:44:56.310007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:44:56.310007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:44:56.310007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:56.310007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:44:56.310007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:44:56.310007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:44:56.310007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:44:56.310007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:44:56.310007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:44:56.310007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:44:56.310007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:44:56.310007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:56.310007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:44:56.310601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:00.916455 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:00.918336 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:00.954411 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:00.954637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:00.955466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:45:00.955466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:00.955466 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:00.955466 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:00.955466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:00.955466 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:00.955466 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:00.955466 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:00.956246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:00.956246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:00.956246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:00.956246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:00.956246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:00.956246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:00.956246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:00.956246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:00.956246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:00.956246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:00.956246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:00.956246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:00.956246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:00.956246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:45:00.956246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:00.956246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:00.956246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:00.957353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:00.963208 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:00.964187 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:00.964388 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:00.964544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:00.965335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:45:00.965335 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:00.965335 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:00.965335 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:00.965335 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:00.965335 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:00.965335 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:00.965335 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:00.967337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:00.967337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:00.967337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:00.967337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:00.967337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:00.967337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:00.967337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:00.967337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:00.967337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:00.967337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:00.967337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:00.967337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:00.967337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:00.967337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:45:00.967337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:00.967337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:00.967810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:01.046112 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:01.046740 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:45:01.047535 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:01.048090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:01.049136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:45:01.049136 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:01.049136 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:01.049136 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:01.049136 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:01.049136 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:01.049136 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:01.049136 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:01.050156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:01.050156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:01.050156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:01.050156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:01.050156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:01.050156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:01.050156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:01.050156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:01.050156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:01.050156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:01.050156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:01.050156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:01.050156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:01.050156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:01.050156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:01.051129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:01.051129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:01.051129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:01.051129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:01.051129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:01.051129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:01.051129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:01.051129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:01.051129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:01.051584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:01.051584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:01.051584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:01.051584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:01.051584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:01.051584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:01.051584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:01.051584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:01.051584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:01.051584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:01.051584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:01.051584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:01.051584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:01.051584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:45:01.051584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:45:01.051584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:01.052421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:01.053551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:01.053551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:01.053551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:01.278188 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:01.278668 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:01.279350 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:01.279740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:01.282403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:01.282962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:01.282962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:01.282962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:01.282962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:01.282962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:01.282962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:01.282962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:01.282962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:01.282962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:01.282962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:01.282962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:01.282962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:01.282962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:01.282962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:01.282962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:01.283371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:01.283836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:01.283836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:01.283836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:01.283836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:01.283836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:01.283836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:01.283836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:01.283836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:01.283836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:01.283836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:01.283836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:01.283836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:01.283836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:01.283836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:01.283836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:01.283836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:01.306194 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:01.306866 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:01.307590 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:01.307899 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:01.308159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:01.308869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:01.308869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:01.308869 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:01.308869 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:01.308869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:01.308869 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:01.308869 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:01.308869 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:01.311329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:01.311329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:01.311329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:01.311329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:01.311329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:01.311329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:01.311329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:01.311329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:01.311329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:01.311329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:01.311329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:01.311329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:01.311329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:01.311329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:45:01.311329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:01.311329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:01.311329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:01.312397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:05.917146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:05.918399 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:05.959407 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:05.959732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:05.960500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:45:05.960500 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:05.960500 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:05.960500 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:05.960500 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:05.960500 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:05.960500 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:05.960500 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:05.961385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:05.961385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:05.961385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:05.961385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:05.961385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:05.961385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:05.961385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:05.961385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:05.961385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:05.961385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:05.961385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:05.961385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:05.961385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:05.961385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:45:05.961385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:05.961385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:05.961385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:05.961861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:05.963520 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:05.964725 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:05.965070 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:05.965292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:05.966473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:45:05.966473 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:05.966473 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:05.966473 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:05.966473 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:05.966473 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:05.966473 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:05.966473 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:05.968454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:05.968454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:05.968454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:05.968454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:05.968454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:05.968454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:05.968454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:05.968454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:05.968454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:05.968454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:05.968454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:05.968454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:05.968454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:05.968454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:45:05.968454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:05.968454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:05.969496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:06.046810 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:06.047348 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:45:06.048109 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:06.048364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:45:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:06.051200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:06.051200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:06.051200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:06.051200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:06.051200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:06.051200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:06.051200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:06.051200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:06.051200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:06.051200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:06.051200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:06.051200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:06.051200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:06.051200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:06.051200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:06.051838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:06.051838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:06.051838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:06.051838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:06.051838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:06.051838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:06.051838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:06.051838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:06.051838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:06.052841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:06.052841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:06.052841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:06.052841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:06.052841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:06.052841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:06.052841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:06.052841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:06.052841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:06.052841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:06.052841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:06.052841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:06.052841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:06.052841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:45:06.052841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:45:06.052841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:06.053588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:06.054512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:06.054512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:06.054512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:06.279016 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:06.279529 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:06.280118 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:06.280486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:06.281457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:06.281457 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:06.281457 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:06.281457 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:06.281457 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:06.281457 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:06.281457 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:06.281457 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:06.282849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:06.282849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:06.282849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:06.282849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:06.282849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:06.282849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:06.282849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:06.282849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:06.282849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:06.282849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:06.282849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:06.282849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:06.282849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:06.282849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:06.282849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:06.282849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:06.283809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:06.283809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:06.283809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:06.283809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:06.283809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:06.283809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:06.283809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:06.283809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:06.284714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:06.284714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:06.284714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:06.284714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:06.284714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:06.284714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:06.284714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:06.284714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:06.284714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:06.284714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:06.284714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:06.284714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:06.284714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:06.284714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:45:06.284714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:45:06.284714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:06.285586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:06.286444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:06.286444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:06.306977 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:06.307528 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:06.308004 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:06.308300 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:06.308435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:06.309056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:06.309056 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:06.309056 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:06.309056 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:06.309056 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:06.309056 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:06.309056 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:06.309056 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:06.311275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:06.311275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:06.311275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:06.311275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:06.311275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:06.311275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:06.311275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:06.311275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:06.311275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:06.311275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:06.311275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:06.311275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:06.311275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:06.311275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:45:06.311275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:06.311275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:06.311275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:06.311880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:10.917836 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:10.918911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:10.954794 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:10.955261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:10.956406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:45:10.956406 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:10.956406 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:10.956406 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:10.956406 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:10.956406 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:10.956406 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:10.956406 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:10.957733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:10.957733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:10.957733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:10.957733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:10.957733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:10.957733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:10.957733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:10.957733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:10.957733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:10.957733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:10.957733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:10.957733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:10.957733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:10.957733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:45:10.957733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:10.957733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:10.957733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:10.958760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:10.963942 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:10.964917 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:10.965326 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:10.965573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:10.966444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:45:10.966444 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:10.966444 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:10.966444 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:10.966444 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:10.966444 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:10.966444 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:10.966444 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:10.967390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:10.967390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:10.967390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:10.967390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:10.967390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:10.967390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:10.967390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:10.967390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:10.967390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:10.967390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:10.967390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:10.967390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:10.967390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:10.967390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:45:10.967390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:10.967390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:10.967827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:11.047552 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:11.048124 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:45:11.049145 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:11.049594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:11.050945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:45:11.050945 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:11.050945 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:11.050945 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:11.050945 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:11.050945 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:11.050945 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:11.050945 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:11.052434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:11.052434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:11.052434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:11.052434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:11.052434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:11.052434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:11.052434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:11.052434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:11.052434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:11.052434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:11.052434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:11.052434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:11.052434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:11.052434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:11.052434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:11.053155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:11.053155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:11.053155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:11.053155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:11.053155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:11.053155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:11.053155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:11.053155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:11.053155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:11.054117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:11.054117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:11.054117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:11.054117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:11.054117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:11.054117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:11.054117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:11.054117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:11.054117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:11.054117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:11.054117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:11.054117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:11.054117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:11.054117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:45:11.054117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:45:11.054117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:11.054815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:11.055636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:11.055636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:11.055636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:11.279704 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:11.280349 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:11.281332 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:11.281772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:11.282719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:11.282719 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:11.282719 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:11.282719 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:11.282719 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:11.282719 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:11.282719 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:11.282719 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:11.284286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:11.284286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:11.284286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:11.284286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:11.284286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:11.284286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:11.284286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:11.284286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:11.284286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:11.284286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:11.284286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:11.284286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:11.284286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:11.284286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:11.284286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:11.284286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:11.285239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:11.285239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:11.285239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:11.285239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:11.285239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:11.285239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:11.285239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:11.285239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:11.285636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:11.285636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:11.285636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:11.285636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:11.285636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:11.285636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:11.285636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:11.285636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:11.285636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:11.285636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:11.285636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:11.285636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:11.285636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:11.285636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:45:11.285636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:45:11.285636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:11.286620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:11.287485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:11.287485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:11.307815 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:11.308263 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:11.309450 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:11.310010 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:11.310311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:11.311355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:11.311355 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:11.311355 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:11.311355 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:11.311355 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:11.311355 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:11.311355 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:11.311355 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:11.313174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:11.313174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:11.313174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:11.313174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:11.313174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:11.313174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:11.313174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:11.313174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:11.313174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:11.313174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:11.313174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:11.313174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:11.313174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:11.313174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:45:11.313174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:11.313174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:11.313174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:11.313948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:15.794767 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:15.805660 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 07 19:45:15.805861 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, security_groups=2, routers=1, router_ports=1 {{(pid=104575) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 07 19:45:15.805947 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Maintenance task: Fixing resource bfbf6c8f-1f7e-474c-a618-4e99355c0282 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:45:15.838729 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, resource={'id': 'bfbf6c8f-1f7e-474c-a618-4e99355c0282', 'name': 'private', 'tenant_id': '47ea4a7c5a154b528631c5537cfdb850', 'project_id': '47ea4a7c5a154b528631c5537cfdb850', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['49f10797-7993-4eac-ad9c-5db13bcf3a17', 'bdd6f685-b77d-459b-b386-e3ef09898997'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:35:01Z', 'updated_at': '2026-04-07T19:35:05Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39614}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:15.839243 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:15.839902 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-ca0b7fb0-3499-4804-b894-4bb867203f37, external_ids_update=None, columns={'tag': 39614}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:15.840153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.841101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:45:15.841101 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:15.841101 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:15.841101 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:15.841101 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:15.841101 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:15.841101 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.841101 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:15.842038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Maintenance task: Failed to fix resource bfbf6c8f-1f7e-474c-a618-4e99355c0282 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.842038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:45:15.842038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:45:15.842038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:45:15.842038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:45:15.842038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:45:15.842038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 19:45:15.842038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:15.842038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:15.842038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:45:15.842038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:15.842728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:15.842728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:15.842728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:45:15.842728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:15.842728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:45:15.842728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:15.842728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:45:15.842728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:45:15.842728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:15.842728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:45:15.842728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:15.842728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:45:15.842728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:45:15.842728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:15.843294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:45:15.843294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.843294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:45:15.843294 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Maintenance task: Fixing resource 92857a9a-261a-45c8-bdf2-793e5d5977e1 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:45:15.869723 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, resource={'id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'name': 'public', 'tenant_id': '47ea4a7c5a154b528631c5537cfdb850', 'project_id': '47ea4a7c5a154b528631c5537cfdb850', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['158905cc-b5be-42da-8777-3d7ded042b7c', '6de186a3-9e7c-4950-a1c6-817a37a68984'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-07T19:35:09Z', 'updated_at': '2026-04-07T19:35:17Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:15.870174 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:15.870830 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-783e27a6-53d0-42e0-a778-7125c7a0cff1, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:15.871242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.872171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:45:15.872171 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:15.872171 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:15.872171 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:15.872171 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:15.872171 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:15.872171 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.872171 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:15.873439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Maintenance task: Failed to fix resource 92857a9a-261a-45c8-bdf2-793e5d5977e1 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.873439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:45:15.873439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:45:15.873439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:45:15.873439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:45:15.873439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:45:15.873439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 19:45:15.873439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:15.873439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:15.873439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:45:15.873439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:15.873926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:15.873926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:15.873926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:45:15.873926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:15.873926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:45:15.873926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:15.873926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:45:15.873926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:45:15.873926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:15.873926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:45:15.873926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:15.873926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:45:15.873926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:45:15.873926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:15.874550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:45:15.874550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.874550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:45:15.874550 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Maintenance task: Fixing resource 246975ba-4717-4c89-a181-15f0da115b38 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:45:15.901151 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-246975ba-4717-4c89-a181-15f0da115b38, resource={'id': '246975ba-4717-4c89-a181-15f0da115b38', 'name': 'admin_net', 'tenant_id': 'c55e43aaf6164fb7ba8075ffd24bc8d2', 'project_id': 'c55e43aaf6164fb7ba8075ffd24bc8d2', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['4b75275b-2834-446a-a1bf-6e510e154273'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:40:24Z', 'updated_at': '2026-04-07T19:40:25Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 64449}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:15.901432 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-246975ba-4717-4c89-a181-15f0da115b38, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:15.901705 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-f0065b7a-ceb5-4313-9c13-1796e417df18, external_ids_update=None, columns={'tag': 64449}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:15.901839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.902430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:45:15.902430 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:15.902430 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:15.902430 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:15.902430 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:15.902430 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:15.902430 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.902430 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:15.903363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Maintenance task: Failed to fix resource 246975ba-4717-4c89-a181-15f0da115b38 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.903363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:45:15.903363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:45:15.903363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:45:15.903363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:45:15.903363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:45:15.903363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 19:45:15.903363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:15.903363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:15.903363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:45:15.903363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:15.903861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:15.903861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:15.903861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:45:15.903861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:15.903861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:45:15.903861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:15.903861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:45:15.903861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:45:15.903861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:15.903861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:45:15.903861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:15.903861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:45:15.903861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:45:15.903861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:15.904426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:45:15.904426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.904426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:45:15.904426 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Maintenance task: Fixing resource 40ad0605-2aac-4da1-b108-03821a0aa715 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:45:15.918593 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:15.919826 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=319 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:45:15.924436 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:15.940082 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-40ad0605-2aac-4da1-b108-03821a0aa715, resource={'id': '40ad0605-2aac-4da1-b108-03821a0aa715', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'tenant_id': '7e48d42664ae4580840a2aef59d52e53', 'project_id': '7e48d42664ae4580840a2aef59d52e53', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['afc68917-6901-4e08-99ad-5c3d8bb8a584'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:41:05Z', 'updated_at': '2026-04-07T19:41:05Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 12961}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:15.943063 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-40ad0605-2aac-4da1-b108-03821a0aa715, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:15.943848 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-7853e8c0-165f-48a8-8e65-36b87d07f16a, external_ids_update=None, columns={'tag': 12961}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:15.944110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.947130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:45:15.947130 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:15.947130 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:15.947130 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:15.947130 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:15.947130 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:15.947130 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.947130 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:15.950144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Maintenance task: Failed to fix resource 40ad0605-2aac-4da1-b108-03821a0aa715 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.950144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:45:15.950144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:45:15.950144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:45:15.950144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:45:15.950144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:45:15.950144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 19:45:15.950144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:15.950144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:15.950144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:45:15.950144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:15.950548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:15.950548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:15.950548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:45:15.950548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:15.950548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:45:15.950548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:15.950548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:45:15.950548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:45:15.950548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:15.950548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:45:15.950548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:15.950548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:45:15.950548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:45:15.950548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:15.950908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:45:15.950908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.950908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:45:15.951331 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Maintenance task: Fixing resource c8541f31-e1ac-4980-a462-6a26475ed613 (type: security_groups) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:45:15.967203 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:15.969151 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:15.969151 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:15.969151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.971542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:45:15.971542 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:15.971542 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:15.971542 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:15.971542 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:15.971542 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:15.971542 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.971542 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:15.981725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.981725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:15.981725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:15.981725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:15.981725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:15.981725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:15.981725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:15.981725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:15.981725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:15.981725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:15.981725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:15.981725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:15.981725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:15.981725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:45:15.981725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:15.981725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.982743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:15.994427 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:15.995425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.996400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 19:45:15.996400 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:15.996400 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:15.996400 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:15.996400 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:15.996400 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:15.996400 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.996400 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:15.999084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:15.999084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:15.999084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:15.999084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:15.999084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:15.999084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:15.999084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:15.999084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:15.999084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:15.999084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:15.999084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:15.999084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:15.999084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:15.999084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:45:15.999084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:15.999084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:15.999084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.000208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:16.018834 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.db.ovn_revision_numbers_db [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Successfully bumped revision number for resource c8541f31-e1ac-4980-a462-6a26475ed613 (type: security_groups) to 10
Apr 07 19:45:16.019055 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Maintenance task: Fixing resource 3436cfe7-c6db-474e-92c1-a2cb0261e502 (type: security_groups) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:45:16.048835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:16.049320 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:45:16.050957 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:16.051386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.054250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:45:16.054250 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:16.054250 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:16.054250 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:16.054250 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:16.054250 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:16.054250 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.054250 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:16.055813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.055813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:16.055813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:16.055813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:16.055813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:16.055813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:16.055813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:16.055813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:16.055813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:16.055813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:16.055813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:16.055813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:16.055813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:16.055813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:16.055813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:16.056683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:16.056683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:16.056683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:16.056683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:16.056683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:16.056683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:16.056683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:16.056683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.056683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:16.058483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.058483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:16.058483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:16.058483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:16.058483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:16.058483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:16.058483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:16.058483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:16.058483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:16.058483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:16.058483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:16.058483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:16.058483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:16.058483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:45:16.058483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:45:16.058483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:16.059049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:16.059625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:16.059625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.059625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:16.075032 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.db.ovn_revision_numbers_db [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Successfully bumped revision number for resource 3436cfe7-c6db-474e-92c1-a2cb0261e502 (type: security_groups) to 15
Apr 07 19:45:16.075441 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Maintenance task: Fixing resource 6e977c5e-85a0-4398-b359-5ba638de167e (type: routers) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:45:16.187574 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, resource={'id': '6e977c5e-85a0-4398-b359-5ba638de167e', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'project_id': '7e48d42664ae4580840a2aef59d52e53', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'external_fixed_ips': [{'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984', 'ip_address': '172.24.5.89'}, {'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c', 'ip_address': '2001:db8::d'}], 'enable_snat': True}, 'gw_port_id': '7f6e42e8-6279-4fd6-9649-d7b189f6dba8', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-a48jf', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'external_fixed_ips': [{'ip_address': '172.24.5.89', 'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984'}, {'ip_address': '2001:db8::d', 'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-07T19:41:06Z', 'updated_at': '2026-04-07T19:41:09Z', 'revision_number': 3, 'tenant_id': '7e48d42664ae4580840a2aef59d52e53'}, resource_type=routers, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:16.187945 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:16.188336 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "7f6e42e8-6279-4fd6-9649-d7b189f6dba8"')], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:16.188567 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "7f6e42e8-6279-4fd6-9649-d7b189f6dba8"')], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:16.188759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.189648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:45:16.189648 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:16.189648 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:16.189648 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:16.189648 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:16.189648 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:16.189648 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.189648 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:16.189870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Unable to update router 6e977c5e-85a0-4398-b359-5ba638de167e. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.191387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Maintenance task: Failed to fix resource 6e977c5e-85a0-4398-b359-5ba638de167e (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.191387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:45:16.191387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:45:16.191387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:45:16.191387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:45:16.191387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:45:16.191387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 07 19:45:16.191387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 07 19:45:16.191387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 07 19:45:16.191387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 07 19:45:16.191387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 07 19:45:16.191801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 07 19:45:16.191801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 07 19:45:16.191801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:16.191801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:16.191801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:45:16.191801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:16.191801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:16.191801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:16.191801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:45:16.191801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:16.191801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:45:16.191801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:16.191801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:45:16.191801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:45:16.192362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:16.192362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:45:16.192362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:16.192362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:45:16.192362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:45:16.192362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:16.192362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:45:16.192362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.192362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:45:16.192362 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Maintenance task: Fixing resource 7f6e42e8-6279-4fd6-9649-d7b189f6dba8 (type: router_ports) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:45:16.283270 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:16.284657 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:16.286687 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:16.288379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.289315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:16.289315 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:16.289315 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:16.289315 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:16.289315 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:16.289315 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:16.289315 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.289315 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:16.290824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.290824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:16.290824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:16.290824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:16.290824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:16.290824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:16.290824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:16.290824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:16.290824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:16.290824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:16.290824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:16.290824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:16.290824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:16.290824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:16.290824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:16.290824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:16.291607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:16.291607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:16.291607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:16.291607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:16.291607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:16.291607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:16.291607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.291607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:16.293608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.293608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:16.293608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:16.293608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:16.293608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:16.293608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:16.293608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:16.293608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:16.293608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:16.293608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:16.293608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:16.293608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:16.293608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:16.293608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:45:16.293608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:45:16.293608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:16.294126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:16.294736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.294736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:16.309010 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:16.309713 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:16.311064 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:16.311461 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:16.311704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.317745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:16.317745 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:16.317745 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:16.317745 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:16.317745 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:16.317745 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:16.317745 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.317745 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:16.320124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.320124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:16.320124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:16.320124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:16.320124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:16.320124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:16.320124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:16.320124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:16.320124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:16.320124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:16.320124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:16.320124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:16.320124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:16.320124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:45:16.320124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:16.320124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:16.320124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.321015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:16.346259 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, resource={'id': '7f6e42e8-6279-4fd6-9649-d7b189f6dba8', 'name': '', 'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'project_id': '', 'mac_address': 'fa:16:3e:18:2e:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e977c5e-85a0-4398-b359-5ba638de167e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984', 'ip_address': '172.24.5.89'}, {'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c', 'ip_address': '2001:db8::d'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000164077', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-07T19:41:06Z', 'updated_at': '2026-04-07T19:41:09Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:16.346674 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '6de186a3-9e7c-4950-a1c6-817a37a68984 158905cc-b5be-42da-8777-3d7ded042b7c', 'neutron:network_name': 'neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-6e977c5e-85a0-4398-b359-5ba638de167e'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::d/64', '172.24.5.89/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:16.347265 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=7f6e42e8-6279-4fd6-9649-d7b189f6dba8, lrouter_port=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:16.347786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.348758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:45:16.348758 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:16.348758 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:16.348758 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:16.348758 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:16.348758 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:16.348758 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.348758 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:16.349848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Maintenance task: Failed to fix resource 7f6e42e8-6279-4fd6-9649-d7b189f6dba8 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.349848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:45:16.349848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:45:16.349848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:45:16.349848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:45:16.349848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:45:16.349848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 07 19:45:16.349848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:16.349848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:16.349848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:45:16.349848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:16.350736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:16.350736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:16.350736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:45:16.350736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:16.350736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:45:16.350736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:16.350736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:45:16.350736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:45:16.350736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:16.350736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:45:16.350736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:16.350736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:45:16.350736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:45:16.350736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:16.351518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:45:16.351518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:16.351518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:45:16.351518 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Maintenance task: Synchronization completed (took 0.54 seconds)
Apr 07 19:45:20.923479 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:20.926881 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:20.957569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:20.957569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:20.957905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:45:20.957905 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:20.957905 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:20.957905 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:20.957905 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:20.957905 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:20.957905 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:20.957905 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:20.959287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:20.959287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:20.959287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:20.959287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:20.959287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:20.959287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:20.959287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:20.959287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:20.959287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:20.959287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:20.959287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:20.959287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:20.959287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:20.959287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:45:20.959287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:20.959287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:20.959287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:20.959776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:20.967759 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:20.969227 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:20.969227 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:20.969227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:20.969559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:45:20.969559 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:20.969559 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:20.969559 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:20.969559 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:20.969559 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:20.969559 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:20.969559 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:20.971624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:20.971624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:20.971624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:20.971624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:20.971624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:20.971624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:20.971624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:20.971624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:20.971624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:20.971624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:20.971624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:20.971624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:20.971624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:20.971624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:45:20.971624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:20.971624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:20.972698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:21.051541 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:21.052371 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:45:21.052754 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:21.052981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:21.053442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:45:21.053442 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:21.053442 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:21.053442 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:21.053442 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:21.053442 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:21.053442 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:21.053442 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:21.054228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:21.054228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:21.054228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:21.054228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:21.054228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:21.054228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:21.054228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:21.054228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:21.054228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:21.054228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:21.054228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:21.054228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:21.054228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:21.054228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:21.054228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:21.054526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:21.054526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:21.054526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:21.054526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:21.054526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:21.054526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:21.054526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:21.054526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:21.054526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:21.055428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:21.055428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:21.055428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:21.055428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:21.055428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:21.055428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:21.055428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:21.055428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:21.055428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:21.055428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:21.055428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:21.055428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:21.055428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:21.055428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:45:21.055428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:45:21.055428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:21.055885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:21.056250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:21.056250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:21.056250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:21.306892 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:21.307394 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:21.308326 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:21.308326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:21.309026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:21.309026 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:21.309026 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:21.309026 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:21.309026 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:21.309026 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:21.309026 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:21.309026 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:21.309625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:21.309625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:21.309625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:21.309625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:21.309625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:21.309625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:21.309625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:21.309625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:21.309625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:21.309625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:21.309625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:21.309625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:21.309625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:21.309625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:21.309625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:21.309625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:21.310025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:21.310025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:21.310025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:21.310025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:21.310025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:21.310025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:21.310025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:21.310025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:21.311087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:21.311087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:21.311087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:21.311087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:21.311087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:21.311087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:21.311087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:21.311087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:21.311087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:21.311087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:21.311087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:21.311087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:21.311087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:21.311087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:45:21.311087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:45:21.311087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:21.311559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:21.312152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:21.312152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:21.312152 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:21.312152 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:21.312152 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:21.312152 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:21.313081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:21.313081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:21.313081 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:21.313081 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:21.313081 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:21.313081 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:21.313081 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:21.313081 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:21.313081 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:21.314230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:21.314230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:21.314230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:21.314230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:21.314230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:21.314230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:21.314230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:21.314230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:21.314230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:21.314230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:21.314230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:21.314230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:21.314230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:21.314230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:45:21.314230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:21.314230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:21.314230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:21.314734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:25.925225 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:25.926693 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:25.967280 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:25.967998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:25.968689 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:25.970311 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:25.971164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:45:25.971164 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:25.971164 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:25.971164 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:25.971164 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:25.971164 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:25.971164 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:25.971164 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:25.972391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:25.972391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:25.972391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:25.972391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:25.972391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:25.972391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:25.972391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:25.972391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:25.972391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:25.972391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:25.972391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:25.972391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:25.972391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:25.972391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:45:25.972391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:25.972391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:25.972391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:25.973321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:25.974367 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:25.974367 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:25.974367 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:45:25.974367 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:25.974367 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:25.974367 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:25.974367 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:25.974367 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:25.974367 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:25.974367 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:25.975954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:25.975954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:25.975954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:25.975954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:25.975954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:25.975954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:25.975954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:25.975954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:25.975954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:25.975954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:25.975954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:25.975954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:25.975954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:25.975954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:45:25.975954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:25.975954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:25.976446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:26.052600 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:26.053313 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:45:26.054152 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:26.054500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:26.055484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:45:26.055484 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:26.055484 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:26.055484 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:26.055484 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:26.055484 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:26.055484 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:26.055484 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:26.056809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:26.056809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:26.056809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:26.056809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:26.056809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:26.056809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:26.056809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:26.056809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:26.056809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:26.056809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:26.056809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:26.056809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:26.056809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:26.056809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:26.056809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:26.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:26.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:26.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:26.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:26.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:26.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:26.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:26.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:26.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:26.058490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:26.058490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:26.058490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:26.058490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:26.058490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:26.058490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:26.058490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:26.058490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:26.058490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:26.058490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:26.058490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:26.058490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:26.058490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:26.058490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:45:26.058490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:45:26.058490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:26.059490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:26.060043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:26.060043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:26.060043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:26.307506 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:26.308324 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:26.365311 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:26.365626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:26.366548 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:26.366757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:26.366757 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:26.366757 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:26.366757 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:26.366757 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:26.366757 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:26.366757 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:26.366757 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:26.367332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:26.367332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:26.367332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:26.367332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:26.367332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:26.367332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:26.367332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:26.367332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:26.367332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:26.367332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:26.367332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:26.367332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:26.367332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:26.367332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:26.367332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:26.367332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:26.367648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:26.367648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:26.367648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:26.367648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:26.367648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:26.367648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:26.367648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:26.367648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:26.368695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:26.368695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:26.368695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:26.368695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:26.368695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:26.368695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:26.368695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:26.368695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:26.368695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:26.368695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:26.368695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:26.368695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:26.368695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:26.368695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:45:26.368695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:45:26.368695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:26.369035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:26.369397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:26.369397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:26.369397 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:26.369707 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:26.369908 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:26.370058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:26.370477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:26.370477 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:26.370477 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:26.370477 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:26.370477 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:26.370477 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:26.370477 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:26.370477 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:26.371458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:26.371458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:26.371458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:26.371458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:26.371458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:26.371458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:26.371458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:26.371458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:26.371458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:26.371458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:26.371458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:26.371458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:26.371458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:26.371458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:45:26.371458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:26.371458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:26.371458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:26.371846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:30.925756 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:30.928243 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:30.959399 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:30.959723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:30.960343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:45:30.960343 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:30.960343 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:30.960343 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:30.960343 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:30.960343 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:30.960343 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:30.960343 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:30.961448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:30.961448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:30.961448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:30.961448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:30.961448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:30.961448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:30.961448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:30.961448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:30.961448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:30.961448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:30.961448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:30.961448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:30.961448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:30.961448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:45:30.961448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:30.961448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:30.961448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:30.962239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:30.969317 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:30.970421 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:30.970739 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:30.970973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:30.971822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:45:30.971822 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:30.971822 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:30.971822 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:30.971822 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:30.971822 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:30.971822 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:30.971822 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:30.973791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:30.973791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:30.973791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:30.973791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:30.973791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:30.973791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:30.973791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:30.973791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:30.973791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:30.973791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:30.973791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:30.973791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:30.973791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:30.973791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:45:30.973791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:30.973791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:30.974241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:31.053335 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:31.054013 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:45:31.054620 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:31.054937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:31.056210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:45:31.056210 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:31.056210 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:31.056210 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:31.056210 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:31.056210 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:31.056210 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:31.056210 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:31.057576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:31.057576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:31.057576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:31.057576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:31.057576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:31.057576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:31.057576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:31.057576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:31.057576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:31.057576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:31.057576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:31.057576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:31.057576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:31.057576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:31.057576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:31.058282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:31.058282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:31.058282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:31.058282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:31.058282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:31.058282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:31.058282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:31.058282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:31.058282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:31.059163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:31.059163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:31.059163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:31.059163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:31.059163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:31.059163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:31.059163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:31.059163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:31.059163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:31.059163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:31.059163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:31.059163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:31.059163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:31.059163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:45:31.059163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:45:31.059163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:31.059903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:31.060741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:31.060741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:31.060741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:31.308257 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:31.309095 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:31.309771 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:31.310238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:31.311149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:45:31.311149 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:31.311149 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:31.311149 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:31.311149 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:31.311149 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:31.311149 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:31.311149 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:31.312742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:31.312742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:31.312742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:31.312742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:31.312742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:31.312742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:31.312742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:31.312742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:31.312742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:31.312742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:31.312742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:31.312742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:31.312742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:31.312742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:31.312742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:31.313835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:31.313835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:31.313835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:31.313835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:31.313835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:31.313835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:31.313835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:31.313835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:31.313835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:31.314669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:31.314669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:31.314669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:31.314669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:31.314669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:31.314669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:31.314669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:31.314669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:31.314669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:31.314669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:31.314669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:31.314669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:31.314669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:31.314669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:45:31.314669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:45:31.314669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:31.315540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:31.317269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:31.317269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:31.368315 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:31.368867 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:31.369565 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:31.370143 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:31.370469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:31.371545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:31.371545 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:31.371545 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:31.371545 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:31.371545 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:31.371545 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:31.371545 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:31.371545 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:31.373756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:31.373756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:31.373756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:31.373756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:31.373756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:31.373756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:31.373756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:31.373756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:31.373756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:31.373756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:31.373756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:31.373756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:31.373756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:31.373756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:45:31.373756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:31.373756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:31.373756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:31.374319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:35.926686 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:35.928651 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:35.967347 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:35.968453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:35.968776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:45:35.968776 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:35.968776 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:35.968776 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:35.968776 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:35.968776 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:35.968776 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:35.968776 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:35.969940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:35.969940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:35.969940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:35.969940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:35.969940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:35.969940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:35.969940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:35.969940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:35.969940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:35.969940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:35.969940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:35.969940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:35.969940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:35.969940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:45:35.969940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:35.969940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:35.969940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:35.970481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:35.971045 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:35.972567 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:35.972567 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:35.972567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:35.972567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:45:35.972567 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:35.972567 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:35.972567 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:35.972567 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:35.972567 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:35.972567 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:35.972567 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:35.973551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:35.973551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:35.973551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:35.973551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:35.973551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:35.973551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:35.973551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:35.973551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:35.973551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:35.973551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:35.973551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:35.973551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:35.973551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:35.973551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:45:35.973551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:35.973551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:35.974815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:36.053929 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:36.055541 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:45:36.057118 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:36.057118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:36.057401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:45:36.057401 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:36.057401 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:36.057401 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:36.057401 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:36.057401 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:36.057401 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:36.057401 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:36.058755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:36.058755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:36.058755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:36.058755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:36.058755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:36.058755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:36.058755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:36.058755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:36.058755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:36.058755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:36.058755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:36.058755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:36.058755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:36.058755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:36.058755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:36.059293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:36.059293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:36.059293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:36.059293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:36.059293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:36.059293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:36.059293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:36.059293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:36.059293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:36.060929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:36.060929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:36.060929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:36.060929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:36.060929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:36.060929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:36.060929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:36.060929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:36.060929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:36.060929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:36.060929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:36.060929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:36.060929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:36.060929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:45:36.060929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:45:36.060929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:36.061456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:36.062021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:36.062021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:36.062021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:36.308854 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:36.309735 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:36.311350 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:36.311350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:36.311529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:36.311529 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:36.311529 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:36.311529 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:36.311529 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:36.311529 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:36.311529 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:36.311529 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:36.312928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:36.312928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:36.312928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:36.312928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:36.312928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:36.312928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:36.312928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:36.312928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:36.312928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:36.312928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:36.312928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:36.312928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:36.312928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:36.312928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:36.312928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:36.312928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:36.314862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:36.314862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:36.314862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:36.314862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:36.314862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:36.314862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:36.314862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:36.314862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:36.314862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:36.314862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:36.314862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:36.314862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:36.314862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:36.314862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:36.314862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:36.314862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:36.315851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:36.316518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:36.316518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:36.316518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:36.316518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:36.316518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:36.316518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:36.316518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:36.316518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:36.316518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:36.368947 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:36.369736 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:36.371208 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:36.371208 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:36.371208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:36.371436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:36.371436 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:36.371436 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:36.371436 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:36.371436 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:36.371436 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:36.371436 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:36.371436 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:36.373223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:36.373223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:36.373223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:36.373223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:36.373223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:36.373223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:36.373223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:36.373223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:36.373223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:36.373223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:36.373223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:36.373223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:36.373223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:36.373223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:45:36.373223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:36.373223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:36.373223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:36.373892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:40.927188 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:40.928156 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:40.964981 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:40.965410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:40.966108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:45:40.966108 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:40.966108 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:40.966108 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:40.966108 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:40.966108 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:40.966108 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:40.966108 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:40.966968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:40.966968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:40.966968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:40.966968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:40.966968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:40.966968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:40.966968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:40.966968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:40.966968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:40.966968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:40.966968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:40.966968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:40.966968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:40.966968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:45:40.966968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:40.966968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:40.966968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:40.967771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:40.970914 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:40.971705 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:40.971961 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:40.972187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:40.972759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:45:40.972759 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:40.972759 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:40.972759 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:40.972759 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:40.972759 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:40.972759 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:40.972759 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:40.974659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:40.974659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:40.974659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:40.974659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:40.974659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:40.974659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:40.974659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:40.974659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:40.974659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:40.974659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:40.974659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:40.974659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:40.974659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:40.974659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:45:40.974659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:40.974659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:40.975149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:41.055387 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:41.056515 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:45:41.057559 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:41.057862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:41.058705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:45:41.058705 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:41.058705 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:41.058705 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:41.058705 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:41.058705 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:41.058705 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:41.058705 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:41.060613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:41.060613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:41.060613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:41.060613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:41.060613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:41.060613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:41.060613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:41.060613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:41.060613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:41.060613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:41.060613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:41.060613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:41.060613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:41.060613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:41.060613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:41.061473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:41.061473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:41.061473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:41.061473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:41.061473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:41.061473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:41.061473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:41.061473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:41.061473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:41.062390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:41.062390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:41.062390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:41.062390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:41.062390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:41.062390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:41.062390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:41.062390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:41.062390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:41.062390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:41.062390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:41.062390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:41.062390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:41.062390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:45:41.062390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:45:41.062390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:41.063154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:41.063611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:41.063611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:41.063611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:41.309846 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:41.310534 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:41.311242 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:41.311535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:41.312598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:45:41.312598 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:41.312598 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:41.312598 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:41.312598 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:41.312598 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:41.312598 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:41.312598 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:41.313668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:41.313668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:41.313668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:41.313668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:41.313668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:41.313668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:41.313668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:41.313668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:41.313668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:41.313668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:41.313668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:41.313668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:41.313668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:41.313668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:41.313668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:41.314331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:41.314331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:41.314331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:41.314331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:41.314331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:41.314331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:41.314331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:41.314331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:41.314331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:41.316379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:41.316379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:41.316379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:41.316379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:41.316379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:41.316379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:41.316379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:41.316379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:41.316379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:41.316379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:41.316379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:41.316379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:41.316379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:41.316379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:45:41.316379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:45:41.316379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:41.316883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:41.317274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:41.317274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:41.369805 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:41.370462 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:41.371161 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:41.371463 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:41.371661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:41.372590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:41.372590 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:41.372590 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:41.372590 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:41.372590 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:41.372590 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:41.372590 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:41.372590 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:41.374348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:41.374348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:41.374348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:41.374348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:41.374348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:41.374348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:41.374348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:41.374348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:41.374348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:41.374348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:41.374348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:41.374348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:41.374348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:41.374348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:45:41.374348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:41.374348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:41.374348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:41.374881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:45.927882 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:45.929224 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:45.963311 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:45.963745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:45.964701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:45:45.964701 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:45.964701 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:45.964701 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:45.964701 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:45.964701 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:45.964701 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:45.964701 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:45.965938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:45.965938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:45.965938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:45.965938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:45.965938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:45.965938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:45.965938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:45.965938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:45.965938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:45.965938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:45.965938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:45.965938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:45.965938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:45.965938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:45:45.965938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:45.965938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:45.965938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:45.966425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:45.971385 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:45.972651 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:45.972960 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:45.973257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:45.974334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:45:45.974334 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:45.974334 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:45.974334 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:45.974334 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:45.974334 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:45.974334 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:45.974334 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:45.976480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:45.976480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:45.976480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:45.976480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:45.976480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:45.976480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:45.976480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:45.976480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:45.976480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:45.976480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:45.976480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:45.976480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:45.976480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:45.976480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:45:45.976480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:45.976480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:45.976940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:46.056225 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:46.056753 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:45:46.057460 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:46.057949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:46.058566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:45:46.058566 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:46.058566 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:46.058566 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:46.058566 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:46.058566 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:46.058566 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:46.058566 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:46.059850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:46.059850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:46.059850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:46.059850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:46.059850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:46.059850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:46.059850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:46.059850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:46.059850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:46.059850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:46.059850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:46.059850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:46.059850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:46.059850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:46.059850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:46.060487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:46.060487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:46.060487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:46.060487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:46.060487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:46.060487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:46.060487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:46.060487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:46.060487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:46.061910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:46.061910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:46.061910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:46.061910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:46.061910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:46.061910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:46.061910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:46.061910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:46.061910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:46.061910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:46.061910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:46.061910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:46.061910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:46.061910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:45:46.061910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:45:46.061910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:46.062433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:46.063093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:46.063093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:46.063093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:46.310555 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:46.311017 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:46.311868 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:46.312333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:46.313228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:45:46.313228 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:46.313228 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:46.313228 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:46.313228 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:46.313228 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:46.313228 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:46.313228 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:46.314079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:46.314079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:46.314079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:46.314079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:46.314079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:46.314079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:46.314079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:46.314079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:46.314079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:46.314079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:46.314079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:46.314079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:46.314079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:46.314079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:46.314079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:46.314879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:46.314879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:46.314879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:46.314879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:46.314879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:46.314879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:46.314879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:46.314879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:46.314879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:46.315503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:46.315503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:46.315503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:46.315503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:46.315503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:46.315503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:46.315503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:46.315503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:46.315503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:46.315503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:46.315503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:46.315503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:46.315503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:46.315503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:45:46.315503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:45:46.315503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:46.316158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:46.317072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:46.317072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:46.370304 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:46.370854 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:46.371510 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:46.371766 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:46.371917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:46.372522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:46.372522 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:46.372522 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:46.372522 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:46.372522 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:46.372522 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:46.372522 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:46.372522 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:46.373875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:46.373875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:46.373875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:46.373875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:46.373875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:46.373875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:46.373875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:46.373875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:46.373875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:46.373875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:46.373875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:46.373875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:46.373875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:46.373875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:45:46.373875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:46.373875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:46.373875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:46.374685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:50.928506 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:50.929934 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:50.965232 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:50.965232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:50.965507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:45:50.965507 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:50.965507 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:50.965507 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:50.965507 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:50.965507 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:50.965507 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:50.965507 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:50.966266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:50.966266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:50.966266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:50.966266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:50.966266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:50.966266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:50.966266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:50.966266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:50.966266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:50.966266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:50.966266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:50.966266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:50.966266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:50.966266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:45:50.966266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:50.966266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:50.966266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:50.967135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:50.971948 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:50.974204 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:50.974204 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:50.974204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:50.974754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:45:50.974754 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:50.974754 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:50.974754 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:50.974754 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:50.974754 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:50.974754 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:50.974754 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:50.976942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:50.976942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:50.976942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:50.976942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:50.976942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:50.976942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:50.976942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:50.976942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:50.976942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:50.976942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:50.976942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:50.976942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:50.976942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:50.976942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:45:50.976942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:50.976942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:50.977634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:51.056935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:51.057655 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:45:51.059361 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:51.059361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:51.059801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:45:51.059801 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:51.059801 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:51.059801 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:51.059801 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:51.059801 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:51.059801 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:51.059801 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:51.061292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:51.061292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:51.061292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:51.061292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:51.061292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:51.061292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:51.061292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:51.061292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:51.061292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:51.061292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:51.061292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:51.061292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:51.061292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:51.061292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:51.061292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:51.062297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:51.062297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:51.062297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:51.062297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:51.062297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:51.062297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:51.062297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:51.062297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:51.062297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:51.063783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:51.063783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:51.063783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:51.063783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:51.063783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:51.063783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:51.063783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:51.063783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:51.063783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:51.063783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:51.063783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:51.063783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:51.063783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:51.063783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:45:51.063783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:45:51.063783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:51.065178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:51.066246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:51.066246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:51.066246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:51.311167 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:51.311940 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:51.313163 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:51.313163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:51.313402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:45:51.313402 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:51.313402 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:51.313402 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:51.313402 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:51.313402 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:51.313402 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:51.313402 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:51.314688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:51.314688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:51.314688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:51.314688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:51.314688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:51.314688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:51.314688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:51.314688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:51.314688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:51.314688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:51.314688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:51.314688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:51.314688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:51.314688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:51.314688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:51.315342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:51.315342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:51.315342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:51.315342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:51.315342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:51.315342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:51.315342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:51.315342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:51.315342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:51.316550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:51.316550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:51.316550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:51.316550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:51.316550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:51.316550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:51.316550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:51.316550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:51.316550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:51.316550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:51.316550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:51.316550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:51.316550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:51.316550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:45:51.316550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:45:51.316550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:51.317019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:51.317454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:51.317454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:51.371150 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:51.371556 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:51.372609 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:51.374244 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:51.374244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:51.374430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:51.374430 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:51.374430 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:51.374430 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:51.374430 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:51.374430 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:51.374430 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:51.374430 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:51.375922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:51.375922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:51.375922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:51.375922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:51.375922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:51.375922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:51.375922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:51.375922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:51.375922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:51.375922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:51.375922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:51.375922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:51.375922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:51.375922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:45:51.375922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:51.375922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:51.375922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:51.376776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:55.929155 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:55.931569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:55.970008 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:55.970288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:55.971171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:45:55.971171 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:55.971171 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:55.971171 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:55.971171 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:55.971171 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:55.971171 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:55.971171 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:55.972634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:55.972634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:55.972634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:55.972634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:55.972634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:55.972634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:55.972634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:55.972634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:55.972634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:55.972634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:55.972634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:55.972634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:55.972634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:55.972634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:45:55.972634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:55.972634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:55.972634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:55.973323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:55.973877 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:55.976432 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:55.976721 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:55.976864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:55.977713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:45:55.977713 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:55.977713 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:55.977713 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:55.977713 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:55.977713 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:55.977713 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:55.977713 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:55.979737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:55.979737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:55.979737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:55.979737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:55.979737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:55.979737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:55.979737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:55.979737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:55.979737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:55.979737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:55.979737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:55.979737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:55.979737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:55.979737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:45:55.979737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:55.979737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:55.980853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:56.057640 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:56.058751 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:45:56.059265 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:56.059516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:56.060280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:45:56.060280 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:56.060280 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:56.060280 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:56.060280 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:56.060280 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:56.060280 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:56.060280 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:56.063118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:56.063118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:56.063118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:56.063118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:56.063118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:56.063118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:56.063118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:56.063118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:56.063118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:56.063118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:56.063118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:56.063118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:56.063118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:56.063118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:56.063118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:56.065790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:56.065790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:56.065790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:56.065790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:56.065790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:56.065790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:56.065790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:56.065790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:56.065790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:56.065790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:56.065790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:56.065790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:56.065790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:56.065790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:56.065790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:56.066414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:56.067191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:56.067191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:56.067191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:56.067191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:56.067191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:56.067191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:56.067191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:56.067191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:56.067191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:56.067191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:56.067191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:56.067191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:56.067191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:56.311846 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:56.312816 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:56.313518 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:56.313969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:56.314827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:45:56.314827 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:56.314827 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:56.314827 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:56.314827 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:56.314827 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:56.314827 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:56.314827 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:56.316137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:56.316137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:45:56.316137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:56.316137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:56.316137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:56.316137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:56.316137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:56.316137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:56.316137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:56.316137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:45:56.316137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:56.316137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:45:56.316137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:56.316137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:45:56.316137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:45:56.316660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:56.316660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:45:56.316660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:56.316660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:45:56.316660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:45:56.316660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:56.316660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:45:56.316660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:56.316660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:45:56.317427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:56.317427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:56.317427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:56.317427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:56.317427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:56.317427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:56.317427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:56.317427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:56.317427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:56.317427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:56.317427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:56.317427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:56.317427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:56.317427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:45:56.317427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:45:56.317427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:56.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:56.318630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:56.318630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:45:56.371705 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:45:56.372307 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:45:56.372806 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:56.373234 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:45:56.373409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:56.375457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:45:56.375457 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:56.375457 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:45:56.375457 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:45:56.375457 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:56.375457 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:45:56.375457 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:56.375457 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:45:56.376601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:56.376601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:45:56.376601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:45:56.376601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:45:56.376601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:45:56.376601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:45:56.376601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:56.376601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:45:56.376601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:45:56.376601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:45:56.376601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:45:56.376601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:45:56.376601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:45:56.376601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:45:56.376601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:45:56.376601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:56.376601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:45:56.377344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:00.930448 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:00.933796 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:00.967904 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:00.968194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:00.969282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:46:00.969282 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:00.969282 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:00.969282 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:00.969282 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:00.969282 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:00.969282 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:00.969282 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:00.969798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:00.969798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:00.969798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:00.969798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:00.969798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:00.969798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:00.969798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:00.969798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:00.969798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:00.969798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:00.969798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:00.969798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:00.969798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:00.969798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:46:00.969798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:00.969798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:00.969798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:00.970203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:00.973827 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:00.974710 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:00.974968 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:00.975224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:00.976064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:46:00.976064 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:00.976064 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:00.976064 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:00.976064 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:00.976064 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:00.976064 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:00.976064 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:00.977154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:00.977154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:00.977154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:00.977154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:00.977154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:00.977154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:00.977154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:00.977154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:00.977154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:00.977154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:00.977154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:00.977154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:00.977154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:00.977154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:46:00.977154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:00.977154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:00.977667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:01.058604 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:01.059176 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:46:01.059807 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:01.060231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:01.061795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:46:01.061795 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:01.061795 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:01.061795 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:01.061795 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:01.061795 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:01.061795 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:01.061795 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:01.062865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:01.062865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:01.062865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:01.062865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:01.062865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:01.062865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:01.062865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:01.062865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:01.062865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:01.062865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:01.062865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:01.062865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:01.062865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:01.062865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:01.062865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:01.063703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:01.063703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:01.063703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:01.063703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:01.063703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:01.063703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:01.063703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:01.063703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:01.063703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:01.064296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:01.064296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:01.064296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:01.064296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:01.064296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:01.064296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:01.064296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:01.064296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:01.064296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:01.064296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:01.064296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:01.064296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:01.064296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:01.064296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:46:01.064296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:46:01.064296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:01.065196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:01.066125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:01.066125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:01.066125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:01.312545 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:01.313483 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:01.313844 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:01.314134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:01.318020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:01.318945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:01.318945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:01.318945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:01.318945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:01.318945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:01.318945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:01.318945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:01.318945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:01.318945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:01.318945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:01.318945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:01.318945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:01.318945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:01.318945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:01.319668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:01.319668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:01.319668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:01.319668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:01.319668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:01.319668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:01.319668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:01.319668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:01.319668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:01.319668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:01.319668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:01.319668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:01.319668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:01.319668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:46:01.319668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:46:01.319668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:01.320396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:01.321371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:01.321371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:01.372541 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:01.373238 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:01.374759 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:01.375413 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:01.375696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:01.376628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:01.376628 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:01.376628 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:01.376628 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:01.376628 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:01.376628 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:01.376628 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:01.376628 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:01.377739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:01.377739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:01.377739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:01.377739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:01.377739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:01.377739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:01.377739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:01.377739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:01.377739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:01.377739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:01.377739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:01.377739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:01.377739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:01.377739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:46:01.377739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:01.377739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:01.377739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:01.378845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:05.933869 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:05.934447 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:05.974353 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:05.978495 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:05.978495 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:05.978495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:05.978775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:46:05.978775 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:05.978775 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:05.978775 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:05.978775 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:05.978775 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:05.978775 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:05.978775 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:05.980511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:05.980511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:05.980511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:05.980511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:05.980511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:05.980511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:05.980511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:05.980511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:05.980511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:05.980511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:05.980511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:05.980511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:05.980511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:05.980511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:46:05.980511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:05.980511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:05.980877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:05.983394 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:05.984102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:05.985161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:46:05.985161 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:05.985161 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:05.985161 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:05.985161 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:05.985161 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:05.985161 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:05.985161 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:05.986135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:05.986135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:05.986135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:05.986135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:05.986135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:05.986135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:05.986135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:05.986135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:05.986135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:05.986135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:05.986135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:05.986135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:05.986135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:05.986135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:46:05.986135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:05.986135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:05.986135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:05.986801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:06.059423 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:06.060018 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:46:06.060666 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:06.061382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:06.062148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:46:06.062148 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:06.062148 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:06.062148 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:06.062148 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:06.062148 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:06.062148 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:06.062148 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:06.063076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:06.063076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:06.063076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:06.063076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:06.063076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:06.063076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:06.063076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:06.063076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:06.063076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:06.063076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:06.063076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:06.063076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:06.063076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:06.063076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:06.063076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:06.063430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:06.063430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:06.063430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:06.063430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:06.063430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:06.063430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:06.063430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:06.063430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:06.063430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:06.064273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:06.064273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:06.064273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:06.064273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:06.064273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:06.064273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:06.064273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:06.064273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:06.064273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:06.064273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:06.064273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:06.064273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:06.064273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:06.064273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:46:06.064273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:46:06.064273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:06.064912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:06.065815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:06.065815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:06.065815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:06.313383 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:06.314095 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:06.314589 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:06.314901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:06.315844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:46:06.315844 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:06.315844 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:06.315844 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:06.315844 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:06.315844 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:06.315844 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:06.315844 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:06.317529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:06.317529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:06.317529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:06.317529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:06.317529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:06.317529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:06.317529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:06.317529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:06.317529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:06.317529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:06.317529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:06.317529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:06.317529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:06.317529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:06.317529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:06.318308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:06.318308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:06.318308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:06.318308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:06.318308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:06.318308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:06.318308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:06.318308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:06.318308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:06.319422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:06.319422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:06.319422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:06.319422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:06.319422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:06.319422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:06.319422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:06.319422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:06.319422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:06.319422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:06.319422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:06.319422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:06.319422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:06.319422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:46:06.319422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:46:06.319422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:06.320104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:06.320682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:06.320682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:06.373221 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:06.373913 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:06.374584 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:06.375068 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:06.375240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:06.376006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:06.376006 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:06.376006 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:06.376006 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:06.376006 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:06.376006 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:06.376006 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:06.376006 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:06.378386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:06.378386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:06.378386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:06.378386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:06.378386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:06.378386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:06.378386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:06.378386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:06.378386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:06.378386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:06.378386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:06.378386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:06.378386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:06.378386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:46:06.378386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:06.378386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:06.378386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:06.379269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:10.933850 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:10.938349 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:10.974603 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:10.975128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:10.976056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:46:10.976056 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:10.976056 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:10.976056 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:10.976056 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:10.976056 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:10.976056 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:10.976056 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:10.977177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:10.977177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:10.977177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:10.977177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:10.977177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:10.977177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:10.977177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:10.977177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:10.977177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:10.977177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:10.977177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:10.977177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:10.977177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:10.977177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:46:10.977177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:10.977177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:10.977177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:10.978125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:10.978966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:10.978966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:10.978966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:10.978966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:10.980430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:46:10.980430 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:10.980430 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:10.980430 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:10.980430 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:10.980430 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:10.980430 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:10.980430 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:10.982354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:10.982354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:10.982354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:10.982354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:10.982354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:10.982354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:10.982354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:10.982354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:10.982354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:10.982354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:10.982354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:10.982354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:10.982354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:10.982354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:46:10.982354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:10.982354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:10.982800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:11.059920 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:11.060238 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:46:11.060639 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:11.060855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:11.061505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:46:11.061505 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:11.061505 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:11.061505 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:11.061505 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:11.061505 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:11.061505 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:11.061505 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:11.062317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:11.062317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:11.062317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:11.062317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:11.062317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:11.062317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:11.062317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:11.062317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:11.062317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:11.062317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:11.062317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:11.062317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:11.062317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:11.062317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:11.062317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:11.063370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:11.063370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:11.063370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:11.063370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:11.063370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:11.063370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:11.063370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:11.063370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:11.063370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:11.063370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:11.063370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:11.063370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:11.063370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:11.063370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:11.063370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:11.064115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:11.065265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:11.065265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:11.065265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:11.065265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:11.065265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:11.065265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:11.065265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:11.065265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:11.065265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:11.065265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:11.065265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:11.065265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:11.065265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:11.314110 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:11.314997 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:11.315820 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:11.316338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:11.317409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:46:11.317409 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:11.317409 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:11.317409 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:11.317409 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:11.317409 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:11.317409 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:11.317409 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:11.318478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:11.318478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:11.318478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:11.318478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:11.318478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:11.318478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:11.318478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:11.318478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:11.318478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:11.318478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:11.318478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:11.318478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:11.318478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:11.318478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:11.318478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:11.319267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:11.319267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:11.319267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:11.319267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:11.319267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:11.319267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:11.319267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:11.319267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:11.319267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:11.319716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:11.319716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:11.319716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:11.319716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:11.319716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:11.319716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:11.319716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:11.319716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:11.319716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:11.319716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:11.319716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:11.319716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:11.319716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:11.319716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:46:11.319716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:46:11.319716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:11.320785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:11.321797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:11.321797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:11.374521 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:11.375017 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:11.375761 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:11.376314 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:11.376803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:11.377715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:11.377715 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:11.377715 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:11.377715 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:11.377715 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:11.377715 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:11.377715 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:11.377715 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:11.379635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:11.379635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:11.379635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:11.379635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:11.379635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:11.379635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:11.379635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:11.379635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:11.379635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:11.379635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:11.379635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:11.379635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:11.379635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:11.379635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:46:11.379635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:11.379635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:11.379635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:11.380533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:15.935046 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:15.936452 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:15.940144 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=392,neutron:UPDATE=2 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:46:15.975473 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:15.975819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:15.976511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:46:15.976511 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:15.976511 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:15.976511 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:15.976511 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:15.976511 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:15.976511 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:15.976511 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:15.977421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:15.977421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:15.977421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:15.977421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:15.977421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:15.977421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:15.977421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:15.977421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:15.977421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:15.977421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:15.977421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:15.977421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:15.977421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:15.977421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:46:15.977421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:15.977421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:15.977421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:15.978983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:15.979678 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:15.979678 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:15.979678 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:15.979909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:15.980725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:46:15.980725 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:15.980725 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:15.980725 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:15.980725 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:15.980725 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:15.980725 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:15.980725 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:15.982690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:15.982690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:15.982690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:15.982690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:15.982690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:15.982690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:15.982690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:15.982690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:15.982690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:15.982690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:15.982690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:15.982690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:15.982690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:15.982690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:46:15.982690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:15.982690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:15.983437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:16.060643 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:16.061200 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:46:16.061932 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:16.062290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:16.063258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:46:16.063258 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:16.063258 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:16.063258 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:16.063258 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:16.063258 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:16.063258 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:16.063258 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:16.064875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:16.064875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:16.064875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:16.064875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:16.064875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:16.064875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:16.064875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:16.064875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:16.064875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:16.064875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:16.064875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:16.064875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:16.064875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:16.064875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:16.064875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:16.065523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:16.065523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:16.065523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:16.065523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:16.065523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:16.065523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:16.065523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:16.065523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:16.065523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:16.068006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:16.068006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:16.068006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:16.068006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:16.068006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:16.068006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:16.068006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:16.068006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:16.068006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:16.068006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:16.068006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:16.068006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:16.068006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:16.068006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:46:16.068006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:46:16.068006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:16.069102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:16.069877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:16.069877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:16.069877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:16.314779 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:16.315442 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:16.316039 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:16.316440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:16.317472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:46:16.317472 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:16.317472 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:16.317472 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:16.317472 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:16.317472 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:16.317472 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:16.317472 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:16.318237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:16.318237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:16.318237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:16.318237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:16.318237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:16.318237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:16.318237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:16.318237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:16.318237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:16.318237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:16.318237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:16.318237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:16.318237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:16.318237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:16.318237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:16.318956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:16.318956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:16.318956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:16.318956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:16.318956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:16.318956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:16.318956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:16.318956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:16.318956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:16.319376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:16.319376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:16.319376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:16.319376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:16.319376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:16.319376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:16.319376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:16.319376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:16.319376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:16.319376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:16.319376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:16.319376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:16.319376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:16.319376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:46:16.319376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:46:16.319376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:16.320076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:16.321153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:16.321153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:16.375110 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:16.375540 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:16.376385 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:16.376807 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:16.377130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:16.378018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:16.378018 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:16.378018 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:16.378018 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:16.378018 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:16.378018 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:16.378018 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:16.378018 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:16.379807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:16.379807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:16.379807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:16.379807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:16.379807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:16.379807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:16.379807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:16.379807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:16.379807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:16.379807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:16.379807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:16.379807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:16.379807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:16.379807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:46:16.379807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:16.379807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:16.379807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:16.380312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:20.935503 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:20.937530 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:20.975329 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:20.975612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:20.976401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:46:20.976401 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:20.976401 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:20.976401 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:20.976401 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:20.976401 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:20.976401 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:20.976401 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:20.977482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:20.977482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:20.977482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:20.977482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:20.977482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:20.977482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:20.977482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:20.977482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:20.977482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:20.977482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:20.977482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:20.977482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:20.977482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:20.977482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:46:20.977482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:20.977482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:20.977482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:20.978538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:20.979968 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:20.979968 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:20.979968 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:20.980296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:20.980836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:46:20.980836 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:20.980836 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:20.980836 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:20.980836 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:20.980836 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:20.980836 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:20.980836 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:20.981938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:20.981938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:20.981938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:20.981938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:20.981938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:20.981938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:20.981938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:20.981938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:20.981938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:20.981938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:20.981938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:20.981938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:20.981938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:20.981938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:46:20.981938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:20.981938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:20.982628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:21.061493 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:21.062169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:46:21.063031 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:21.063434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:21.064470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:46:21.064470 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:21.064470 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:21.064470 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:21.064470 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:21.064470 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:21.064470 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:21.064470 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:21.067628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:21.067628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:21.067628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:21.067628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:21.067628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:21.067628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:21.067628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:21.067628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:21.067628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:21.067628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:21.067628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:21.067628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:21.067628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:21.067628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:21.067628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:21.069542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:21.069542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:21.069542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:21.069542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:21.069542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:21.069542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:21.069542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:21.069542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:21.069542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:21.069542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:21.069542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:21.069542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:21.069542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:21.069542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:21.069542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:21.070449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:21.071389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:21.071389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:21.071389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:21.071389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:21.071389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:21.071389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:21.071389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:21.071389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:21.071389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:21.071389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:21.071389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:21.071389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:21.071389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:21.315418 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:21.315998 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:21.316744 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:21.317172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:21.317955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:46:21.317955 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:21.317955 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:21.317955 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:21.317955 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:21.317955 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:21.317955 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:21.317955 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:21.318845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:21.318845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:21.318845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:21.318845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:21.318845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:21.318845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:21.318845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:21.318845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:21.318845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:21.318845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:21.318845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:21.318845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:21.318845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:21.318845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:21.318845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:21.319367 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:21.319367 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:21.319367 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:21.319367 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:21.319367 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:21.319367 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:21.319367 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:21.319367 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:21.319367 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:21.320103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:21.320103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:21.320103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:21.320103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:21.320103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:21.320103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:21.320103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:21.320103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:21.320103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:21.320103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:21.320103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:21.320103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:21.320103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:21.320103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:46:21.320103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:46:21.320103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:21.320854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:21.321801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:21.321801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:21.375612 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:21.376491 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:21.376491 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:21.377010 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:21.377010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:21.377385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:21.377385 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:21.377385 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:21.377385 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:21.377385 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:21.377385 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:21.377385 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:21.377385 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:21.378383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:21.378383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:21.378383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:21.378383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:21.378383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:21.378383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:21.378383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:21.378383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:21.378383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:21.378383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:21.378383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:21.378383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:21.378383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:21.378383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:46:21.378383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:21.378383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:21.378383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:21.379115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:25.936199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:25.938084 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:25.974841 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:25.975223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:25.976000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:46:25.976000 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:25.976000 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:25.976000 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:25.976000 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:25.976000 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:25.976000 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:25.976000 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:25.976927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:25.976927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:25.976927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:25.976927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:25.976927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:25.976927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:25.976927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:25.976927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:25.976927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:25.976927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:25.976927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:25.976927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:25.976927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:25.976927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:46:25.976927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:25.976927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:25.976927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:25.977623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:25.979324 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:25.980440 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:25.992310 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:25.992310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:25.992310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:46:25.992310 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:25.992310 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:25.992310 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:25.992310 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:25.992310 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:25.992310 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:25.992310 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:25.992310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:25.992310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:25.992310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:25.992310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:25.993264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:25.994236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:25.994236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:25.994236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:25.994236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:25.994236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:25.994236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:25.994236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:25.994236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:25.994236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:25.994236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:25.994236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:25.994236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:26.062165 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:26.062721 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:46:26.063325 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:26.063493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:26.064086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 19:46:26.064086 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:26.064086 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:26.064086 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:26.064086 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:26.064086 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:26.064086 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:26.064086 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:26.065091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:26.065091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:26.065091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:26.065091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:26.065091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:26.065091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:26.065091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:26.065091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:26.065091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:26.065091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:26.065091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:26.065091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:26.065091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:26.065091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:26.065091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:26.065445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:26.065445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:26.065445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:26.065445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:26.065445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:26.065445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:26.065445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:26.065445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:26.065445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:26.066547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:26.066547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:26.066547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:26.066547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:26.066547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:26.066547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:26.066547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:26.066547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:26.066547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:26.066547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:26.066547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:26.066547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:26.066547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:26.066547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:46:26.066547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:46:26.066547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:26.067026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:26.068179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:26.068179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:26.068179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:26.316164 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:26.316717 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:26.317520 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:26.317856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:26.318663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:46:26.318663 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:26.318663 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:26.318663 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:26.318663 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:26.318663 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:26.318663 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:26.318663 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:26.320008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:26.320008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:26.320008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:26.320008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:26.320008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:26.320008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:26.320008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:26.320008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:26.320008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:26.320008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:26.320008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:26.320008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:26.320008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:26.320008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:26.320008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:26.320313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:26.320313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:26.320313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:26.320313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:26.320313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:26.320313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:26.320313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:26.320313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:26.320313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:26.321794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:26.321794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:26.321794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:26.321794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:26.321794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:26.321794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:26.321794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:26.321794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:26.321794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:26.321794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:26.321794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:26.321794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:26.321794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:26.321794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:46:26.321794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:46:26.321794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:26.322157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:26.322491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:26.322491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:26.376660 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:26.377782 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:26.378574 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:26.379015 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:26.379270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:26.380318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:26.380318 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:26.380318 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:26.380318 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:26.380318 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:26.380318 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:26.380318 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:26.380318 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:26.382201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:26.382201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:26.382201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:26.382201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:26.382201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:26.382201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:26.382201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:26.382201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:26.382201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:26.382201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:26.382201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:26.382201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:26.382201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:26.382201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:46:26.382201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:26.382201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:26.382201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:26.383031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:30.937037 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:30.939121 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:30.976360 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:30.976624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:30.977328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:46:30.977328 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:30.977328 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:30.977328 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:30.977328 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:30.977328 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:30.977328 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:30.977328 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:30.978344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:30.978344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:30.978344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:30.978344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:30.978344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:30.978344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:30.978344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:30.978344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:30.978344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:30.978344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:30.978344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:30.978344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:30.978344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:30.978344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:46:30.978344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:30.978344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:30.978344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:30.978833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:30.979909 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:30.980751 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:30.981003 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:30.981166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:30.981779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:46:30.981779 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:30.981779 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:30.981779 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:30.981779 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:30.981779 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:30.981779 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:30.981779 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:30.983014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:30.983014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:30.983014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:30.983014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:30.983014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:30.983014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:30.983014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:30.983014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:30.983014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:30.983014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:30.983014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:30.983014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:30.983014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:30.983014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:46:30.983014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:30.983014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:30.983864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:31.062847 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:31.063233 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:46:31.063834 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:31.064021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:31.064728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:31.064728 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:31.064728 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:31.064728 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:31.064728 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:31.064728 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:31.064728 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:31.064728 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:31.065669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:31.065669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:31.065669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:31.065669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:31.065669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:31.065669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:31.065669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:31.065669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:31.065669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:31.065669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:31.065669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:31.065669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:31.065669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:31.065669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:31.065669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:31.065669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:31.067283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:31.067283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:31.067283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:31.067283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:31.067283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:31.067283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:31.067283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:31.067283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:31.067283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:31.067283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:31.067283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:31.067283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:31.067283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:31.067283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:31.067283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:31.067283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:31.067808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:31.068356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:31.068356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:31.068356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:31.068356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:31.068356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:31.068356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:31.068356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:31.068356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:31.068356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:31.068356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:31.068356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:31.316908 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:31.317527 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:31.318243 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:31.318640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:31.319692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:46:31.319692 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:31.319692 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:31.319692 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:31.319692 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:31.319692 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:31.319692 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:31.319692 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:31.321539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:31.321539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:31.321539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:31.321539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:31.321539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:31.321539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:31.321539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:31.321539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:31.321539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:31.321539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:31.321539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:31.321539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:31.321539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:31.321539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:31.321539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:31.322024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:31.322024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:31.322024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:31.322024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:31.322024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:31.322024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:31.322024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:31.322024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:31.322024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:31.323694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:31.323694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:31.323694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:31.323694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:31.323694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:31.323694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:31.323694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:31.323694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:31.323694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:31.323694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:31.323694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:31.323694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:31.323694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:31.323694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:46:31.323694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:46:31.323694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:31.324255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:31.324853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:31.324853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:31.377549 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:31.377947 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:31.378484 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:31.378929 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:31.379218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:31.380243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:31.380243 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:31.380243 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:31.380243 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:31.380243 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:31.380243 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:31.380243 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:31.380243 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:31.381875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:31.381875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:31.381875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:31.381875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:31.381875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:31.381875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:31.381875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:31.381875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:31.381875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:31.381875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:31.381875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:31.381875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:31.381875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:31.381875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:46:31.381875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:31.381875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:31.381875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:31.382723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:35.938661 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:35.939953 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:35.980489 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:35.985706 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:35.986231 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:35.986427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:35.991129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:46:35.991129 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:35.991129 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:35.991129 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:35.991129 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:35.991129 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:35.991129 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:35.991129 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:35.994416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:35.994416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:35.994416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:35.994416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:35.994416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:35.994416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:35.994416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:35.994416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:35.994416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:35.994416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:35.994416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:35.994416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:35.994416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:35.994416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:46:35.994416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:35.994416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:35.994844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:35.996158 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:35.996486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:35.997294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:46:35.997294 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:35.997294 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:35.997294 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:35.997294 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:35.997294 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:35.997294 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:35.997294 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:35.998561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:35.998561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:35.998561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:35.998561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:35.998561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:35.998561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:35.998561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:35.998561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:35.998561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:35.998561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:35.998561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:35.998561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:35.998561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:35.998561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:46:35.998561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:35.998561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:35.998561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:35.998898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:36.063522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:36.063967 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:46:36.064930 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:36.065286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:36.066197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:36.066197 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:36.066197 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:36.066197 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:36.066197 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:36.066197 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:36.066197 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:36.066197 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:36.067954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:36.067954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:36.067954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:36.067954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:36.067954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:36.067954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:36.067954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:36.067954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:36.067954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:36.067954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:36.067954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:36.067954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:36.067954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:36.067954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:36.067954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:36.067954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:36.068927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:36.068927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:36.068927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:36.068927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:36.068927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:36.068927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:36.068927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:36.068927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:36.070145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:36.070145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:36.070145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:36.070145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:36.070145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:36.070145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:36.070145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:36.070145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:36.070145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:36.070145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:36.070145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:36.070145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:36.070145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:36.070145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:46:36.070145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:46:36.070145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:36.071337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:36.072527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:36.072527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:36.072527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:36.317750 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:36.318453 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:36.319273 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:36.319697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:36.320925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:46:36.320925 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:36.320925 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:36.320925 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:36.320925 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:36.320925 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:36.320925 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:36.320925 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:36.322237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:36.322237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:36.322237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:36.322237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:36.322237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:36.322237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:36.322237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:36.322237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:36.322237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:36.322237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:36.322237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:36.322237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:36.322237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:36.322237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:36.322237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:36.322674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:36.322674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:36.322674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:36.322674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:36.322674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:36.322674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:36.322674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:36.322674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:36.322674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:36.324185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:36.324185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:36.324185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:36.324185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:36.324185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:36.324185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:36.324185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:36.324185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:36.324185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:36.324185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:36.324185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:36.324185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:36.324185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:36.324185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:46:36.324185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:46:36.324185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:36.324776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:36.326076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:36.326076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:36.378165 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:36.379459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:36.379940 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:36.380430 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:36.380736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:36.382182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:36.382182 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:36.382182 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:36.382182 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:36.382182 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:36.382182 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:36.382182 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:36.382182 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:36.382670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:36.382670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:36.382670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:36.382670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:36.382670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:36.382670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:36.382670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:36.382670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:36.382670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:36.382670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:36.382670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:36.382670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:36.382670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:36.382670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:46:36.382670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:36.382670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:36.382670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:36.383064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:40.939491 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:40.941458 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:40.981264 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:40.983204 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:40.983477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:40.984561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:46:40.984561 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:40.984561 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:40.984561 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:40.984561 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:40.984561 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:40.984561 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:40.984561 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:40.985026 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:40.986334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:40.986334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:40.986334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:40.986334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:40.986334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:40.986334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:40.986334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:40.986334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:40.986334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:40.986334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:40.986334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:40.986334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:40.986334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:40.986334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:46:40.986334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:40.986334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:40.986334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:40.987100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:40.987854 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:40.987854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:40.987854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:46:40.987854 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:40.987854 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:40.987854 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:40.987854 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:40.987854 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:40.987854 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:40.987854 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:40.988522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:40.988522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:40.988522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:40.988522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:40.988522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:40.988522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:40.988522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:40.988522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:40.988522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:40.988522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:40.988522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:40.988522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:40.988522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:40.988522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:46:40.988522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:40.988522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:40.989346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:41.064114 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:41.064435 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:46:41.064947 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:41.065129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:41.065909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:41.065909 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:41.065909 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:41.065909 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:41.065909 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:41.065909 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:41.065909 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:41.065909 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:41.067346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:41.067346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:41.067346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:41.067346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:41.067346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:41.067346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:41.067346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:41.067346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:41.067346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:41.067346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:41.067346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:41.067346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:41.067346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:41.067346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:41.067346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:41.067346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:41.068148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:41.068148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:41.068148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:41.068148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:41.068148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:41.068148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:41.068148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:41.068148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:41.068914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:41.068914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:41.068914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:41.068914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:41.068914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:41.068914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:41.068914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:41.068914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:41.068914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:41.068914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:41.068914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:41.068914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:41.068914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:41.068914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:46:41.068914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:46:41.068914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:41.069578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:41.070128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:41.070128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:41.070128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:41.318365 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:41.319128 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:41.320030 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:41.320780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:41.321635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:46:41.321635 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:41.321635 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:41.321635 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:41.321635 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:41.321635 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:41.321635 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:41.321635 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:41.322665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:41.322665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:41.322665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:41.322665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:41.322665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:41.322665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:41.322665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:41.322665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:41.322665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:41.322665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:41.322665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:41.322665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:41.322665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:41.322665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:41.322665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:41.324042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:41.324042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:41.324042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:41.324042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:41.324042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:41.324042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:41.324042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:41.324042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:41.324042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:41.324042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:41.324042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:41.324042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:41.324042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:41.324042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:41.324042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:41.325214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:41.326037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:41.326037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:41.326037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:41.326037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:41.326037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:41.326037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:41.326037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:41.326037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:41.326037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:41.326037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:41.326037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:41.326037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:41.379654 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:41.380261 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:41.380871 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:41.381207 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:41.381366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:41.382302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:41.382302 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:41.382302 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:41.382302 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:41.382302 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:41.382302 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:41.382302 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:41.382302 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:41.384759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:41.384759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:41.384759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:41.384759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:41.384759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:41.384759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:41.384759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:41.384759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:41.384759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:41.384759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:41.384759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:41.384759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:41.384759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:41.384759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:46:41.384759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:41.384759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:41.384759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:41.385574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:45.940707 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:45.941974 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:45.982588 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:45.985089 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:45.985329 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:45.985523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:45.986907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:46:45.986907 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:45.986907 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:45.986907 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:45.986907 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:45.986907 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:45.986907 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:45.986907 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:45.987419 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:45.989487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:45.989487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:45.989487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:45.989487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:45.989487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:45.989487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:45.989487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:45.989487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:45.989487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:45.989487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:45.989487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:45.989487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:45.989487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:45.989487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:46:45.989487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:45.989487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:45.990435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:45.991364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:45.991364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:46:45.991364 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:45.991364 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:45.991364 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:45.991364 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:45.991364 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:45.991364 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:45.991364 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:45.991883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:45.991883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:45.991883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:45.991883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:45.991883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:45.991883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:45.991883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:45.991883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:45.991883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:45.991883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:45.991883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:45.991883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:45.991883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:45.991883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:46:45.991883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:45.991883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:45.991883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:45.992598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:46.064640 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:46.065098 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:46:46.065903 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:46.066237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:46.067098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:46.067098 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:46.067098 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:46.067098 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:46.067098 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:46.067098 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:46.067098 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:46.067098 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:46.068344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:46.068344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:46.068344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:46.068344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:46.068344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:46.068344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:46.068344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:46.068344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:46.068344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:46.068344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:46.068344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:46.068344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:46.068344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:46.068344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:46.068344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:46.068344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:46.071386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:46.071386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:46.071386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:46.071386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:46.071386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:46.071386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:46.071386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:46.071386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:46.072154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:46.072154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:46.072154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:46.072154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:46.072154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:46.072154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:46.072154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:46.072154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:46.072154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:46.072154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:46.072154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:46.072154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:46.072154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:46.072154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:46:46.072154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:46:46.072154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:46.073357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:46.074137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:46.074137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:46.074137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:46.318921 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:46.319467 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:46.320243 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:46.320714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:46.321674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:46:46.321674 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:46.321674 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:46.321674 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:46.321674 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:46.321674 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:46.321674 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:46.321674 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:46.322511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:46.322511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:46.322511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:46.322511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:46.322511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:46.322511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:46.322511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:46.322511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:46.322511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:46.322511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:46.322511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:46.322511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:46.322511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:46.322511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:46.322511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:46.322816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:46.322816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:46.322816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:46.322816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:46.322816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:46.322816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:46.322816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:46.322816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:46.322816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:46.323632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:46.323632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:46.323632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:46.323632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:46.323632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:46.323632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:46.323632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:46.323632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:46.323632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:46.323632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:46.323632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:46.323632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:46.323632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:46.323632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:46:46.323632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:46:46.323632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:46.323955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:46.324313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:46.324313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:46.380329 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:46.380866 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:46.381751 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:46.382119 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:46.382350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:46.383200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:46.383200 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:46.383200 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:46.383200 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:46.383200 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:46.383200 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:46.383200 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:46.383200 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:46.384558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:46.384558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:46.384558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:46.384558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:46.384558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:46.384558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:46.384558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:46.384558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:46.384558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:46.384558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:46.384558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:46.384558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:46.384558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:46.384558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:46:46.384558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:46.384558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:46.384558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:46.385269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:50.940837 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:50.942178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:50.976749 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:50.977202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:50.978232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:46:50.978232 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:50.978232 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:50.978232 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:50.978232 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:50.978232 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:50.978232 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:50.978232 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:50.979363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:50.979363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:50.979363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:50.979363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:50.979363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:50.979363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:50.979363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:50.979363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:50.979363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:50.979363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:50.979363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:50.979363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:50.979363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:50.979363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:46:50.979363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:50.979363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:50.979363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:50.979912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:50.984306 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:50.985680 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:50.986307 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:50.986577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:50.987640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:46:50.987640 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:50.987640 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:50.987640 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:50.987640 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:50.987640 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:50.987640 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:50.987640 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:50.991604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:50.991604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:50.991604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:50.991604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:50.991604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:50.991604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:50.991604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:50.991604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:50.991604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:50.991604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:50.991604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:50.991604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:50.991604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:50.991604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:46:50.991604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:50.991604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:50.992112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:51.065257 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:51.065845 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:46:51.066684 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:51.066972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:51.067651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:51.067651 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:51.067651 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:51.067651 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:51.067651 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:51.067651 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:51.067651 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:51.067651 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:51.069481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:51.069481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:51.069481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:51.069481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:51.069481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:51.069481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:51.069481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:51.069481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:51.069481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:51.069481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:51.069481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:51.069481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:51.069481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:51.069481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:51.069481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:51.069481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:51.069916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:51.069916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:51.069916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:51.069916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:51.069916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:51.069916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:51.069916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:51.069916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:51.071865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:51.071865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:51.071865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:51.071865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:51.071865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:51.071865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:51.071865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:51.071865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:51.071865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:51.071865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:51.071865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:51.071865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:51.071865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:51.071865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:46:51.071865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:46:51.071865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:51.072750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:51.073347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:51.073347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:51.073347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:51.319560 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:51.319956 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:51.320676 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:51.320951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:51.321615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:46:51.321615 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:51.321615 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:51.321615 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:51.321615 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:51.321615 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:51.321615 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:51.321615 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:51.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:51.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:51.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:51.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:51.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:51.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:51.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:51.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:51.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:51.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:51.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:51.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:51.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:51.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:51.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:51.323400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:51.323400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:51.323400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:51.323400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:51.323400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:51.323400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:51.323400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:51.323400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:51.323400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:51.324116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:51.324116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:51.324116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:51.324116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:51.324116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:51.324116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:51.324116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:51.324116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:51.324116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:51.324116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:51.324116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:51.324116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:51.324116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:51.324116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:46:51.324116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:46:51.324116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:51.324616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:51.325292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:51.325292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:51.381252 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:51.382227 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:51.383007 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:51.383629 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:51.384000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:51.385412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:51.385412 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:51.385412 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:51.385412 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:51.385412 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:51.385412 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:51.385412 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:51.385412 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:51.386717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:51.386717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:51.386717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:51.386717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:51.386717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:51.386717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:51.386717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:51.386717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:51.386717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:51.386717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:51.386717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:51.386717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:51.386717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:51.386717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:46:51.386717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:51.386717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:51.386717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:51.387241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:55.943167 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:55.943167 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:55.975735 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:55.976208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:55.977075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:46:55.977075 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:55.977075 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:55.977075 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:55.977075 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:55.977075 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:55.977075 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:55.977075 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:55.977907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:55.977907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:55.977907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:55.977907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:55.977907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:55.977907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:55.977907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:55.977907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:55.977907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:55.977907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:55.977907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:55.977907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:55.977907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:55.977907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:46:55.977907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:55.977907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:55.977907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:55.978612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:55.984902 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:55.986146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:55.986486 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:55.986770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:55.987628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:46:55.987628 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:55.987628 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:55.987628 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:55.987628 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:55.987628 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:55.987628 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:55.987628 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:55.988936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:55.988936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:55.988936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:55.988936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:55.988936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:55.988936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:55.988936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:55.988936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:55.988936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:55.988936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:55.988936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:55.988936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:55.988936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:55.988936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:46:55.988936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:55.988936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:55.989533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:56.066212 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:56.066461 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:46:56.067318 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:56.067706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:56.068667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:56.068667 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:56.068667 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:56.068667 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:56.068667 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:56.068667 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:56.068667 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:56.068667 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:56.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:56.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:56.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:56.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:56.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:56.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:56.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:56.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:56.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:56.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:56.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:56.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:56.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:56.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:56.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:56.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:56.070685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:56.070685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:56.070685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:56.070685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:56.070685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:56.070685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:56.070685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:56.070685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:56.071478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:56.071478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:56.071478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:56.071478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:56.071478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:56.071478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:56.071478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:56.071478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:56.071478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:56.071478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:56.071478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:56.071478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:56.071478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:56.071478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:46:56.071478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:46:56.071478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:56.072194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:56.072922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:56.072922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:56.072922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:56.320548 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:56.321192 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:56.322216 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:56.322216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:56.322452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:46:56.322452 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:56.322452 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:56.322452 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:56.322452 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:56.322452 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:56.322452 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:56.322452 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:56.323330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:56.323330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:46:56.323330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:56.323330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:56.323330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:56.323330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:56.323330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:56.323330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:56.323330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:56.323330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:46:56.323330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:56.323330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:46:56.323330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:56.323330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:46:56.323330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:46:56.323752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:56.323752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:46:56.323752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:56.323752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:46:56.323752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:46:56.323752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:56.323752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:46:56.323752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:56.323752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:46:56.324630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:56.324630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:56.324630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:56.324630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:56.324630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:56.324630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:56.324630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:56.324630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:56.324630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:56.324630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:56.324630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:56.324630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:56.324630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:56.324630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:46:56.324630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:46:56.324630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:56.325452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:56.326009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:56.326009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:46:56.382420 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:46:56.383135 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:46:56.383917 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:56.384819 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:46:56.384819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:56.385414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:46:56.385414 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:56.385414 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:46:56.385414 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:46:56.385414 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:56.385414 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:46:56.385414 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:56.385414 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:46:56.386426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:56.386426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:46:56.386426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:46:56.386426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:46:56.386426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:46:56.386426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:46:56.386426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:56.386426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:46:56.386426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:46:56.386426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:46:56.386426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:46:56.386426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:46:56.386426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:46:56.386426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:46:56.386426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:46:56.386426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:56.386426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:46:56.386889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:00.942236 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:00.944530 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:00.980956 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:00.981378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:00.982394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:47:00.982394 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:00.982394 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:00.982394 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:00.982394 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:00.982394 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:00.982394 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:00.982394 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:00.983770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:00.983770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:00.983770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:00.983770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:00.983770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:00.983770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:00.983770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:00.983770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:00.983770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:00.983770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:00.983770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:00.983770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:00.983770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:00.983770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:47:00.983770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:00.983770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:00.983770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:00.985180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:00.986053 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:00.986916 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:00.987299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:00.987700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:00.988730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:47:00.988730 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:00.988730 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:00.988730 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:00.988730 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:00.988730 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:00.988730 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:00.988730 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:00.990045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:00.990045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:00.990045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:00.990045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:00.990045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:00.990045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:00.990045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:00.990045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:00.990045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:00.990045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:00.990045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:00.990045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:00.990045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:00.990045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:47:00.990045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:00.990045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:00.990560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:01.066768 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:01.067293 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:47:01.067812 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:01.068150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:01.068850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:01.068850 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:01.068850 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:01.068850 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:01.068850 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:01.068850 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:01.068850 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:01.068850 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:01.070008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:01.070008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:01.070008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:01.070008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:01.070008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:01.070008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:01.070008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:01.070008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:01.070008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:01.070008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:01.070008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:01.070008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:01.070008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:01.070008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:01.070008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:01.070008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:01.070975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:01.070975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:01.070975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:01.070975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:01.070975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:01.070975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:01.070975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:01.070975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:01.071669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:01.071669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:01.071669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:01.071669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:01.071669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:01.071669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:01.071669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:01.071669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:01.071669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:01.071669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:01.071669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:01.071669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:01.071669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:01.071669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:47:01.071669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:47:01.071669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:01.072227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:01.072735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:01.072735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:01.072735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:01.321362 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:01.321963 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:01.322718 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:01.323149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:01.324225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:47:01.324225 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:01.324225 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:01.324225 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:01.324225 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:01.324225 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:01.324225 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:01.324225 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:01.325557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:01.325557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:01.325557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:01.325557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:01.325557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:01.325557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:01.325557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:01.325557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:01.325557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:01.325557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:01.325557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:01.325557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:01.325557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:01.325557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:01.325557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:01.326140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:01.326140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:01.326140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:01.326140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:01.326140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:01.326140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:01.326140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:01.326140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:01.326140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:01.327224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:01.327224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:01.327224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:01.327224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:01.327224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:01.327224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:01.327224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:01.327224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:01.327224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:01.327224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:01.327224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:01.327224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:01.327224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:01.327224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:47:01.327224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:47:01.327224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:01.327743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:01.328240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:01.328240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:01.383236 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:01.383615 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:01.384566 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:01.385128 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:01.385436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:01.386416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:01.386416 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:01.386416 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:01.386416 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:01.386416 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:01.386416 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:01.386416 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:01.386416 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:01.388239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:01.388239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:01.388239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:01.388239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:01.388239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:01.388239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:01.388239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:01.388239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:01.388239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:01.388239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:01.388239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:01.388239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:01.388239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:01.388239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:47:01.388239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:01.388239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:01.388239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:01.388716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:05.942894 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:05.944141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:05.981560 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:05.981850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:05.982613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:47:05.982613 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:05.982613 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:05.982613 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:05.982613 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:05.982613 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:05.982613 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:05.982613 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:05.984189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:05.984189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:05.984189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:05.984189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:05.984189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:05.984189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:05.984189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:05.984189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:05.984189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:05.984189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:05.984189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:05.984189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:05.984189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:05.984189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:47:05.984189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:05.984189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:05.984189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:05.986362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:05.987669 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:05.987669 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:05.987669 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:05.987669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:05.987669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:47:05.987669 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:05.987669 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:05.987669 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:05.987669 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:05.987669 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:05.987669 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:05.987669 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:05.988487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:05.988487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:05.988487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:05.988487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:05.988487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:05.988487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:05.988487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:05.988487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:05.988487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:05.988487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:05.988487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:05.988487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:05.988487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:05.988487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:47:05.988487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:05.988487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:05.989325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:06.067380 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:06.067797 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:47:06.068364 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:06.068742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:06.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:06.069926 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:06.069926 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:06.069926 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:06.069926 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:06.069926 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:06.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:06.069926 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:06.071119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:06.071119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:06.071119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:06.071119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:06.071119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:06.071119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:06.071119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:06.071119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:06.071119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:06.071119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:06.071119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:06.071119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:06.071119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:06.071119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:06.071119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:06.071119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:06.071773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:06.071773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:06.071773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:06.071773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:06.071773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:06.071773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:06.071773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:06.071773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:06.072516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:06.072516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:06.072516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:06.072516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:06.072516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:06.072516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:06.072516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:06.072516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:06.072516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:06.072516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:06.072516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:06.072516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:06.072516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:06.072516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:47:06.072516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:47:06.072516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:06.073052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:06.073633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:06.073633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:06.073633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:06.322218 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:06.323316 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:06.324223 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:06.324740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:06.325713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:47:06.325713 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:06.325713 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:06.325713 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:06.325713 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:06.325713 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:06.325713 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:06.325713 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:06.327172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:06.327172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:06.327172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:06.327172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:06.327172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:06.327172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:06.327172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:06.327172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:06.327172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:06.327172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:06.327172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:06.327172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:06.327172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:06.327172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:06.327172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:06.327495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:06.327495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:06.327495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:06.327495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:06.327495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:06.327495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:06.327495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:06.327495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:06.327495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:06.328253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:06.328253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:06.328253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:06.328253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:06.328253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:06.328253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:06.328253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:06.328253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:06.328253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:06.328253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:06.328253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:06.328253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:06.328253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:06.328253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:47:06.328253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:47:06.328253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:06.328647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:06.329093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:06.329093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:06.383935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:06.384483 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:06.385083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:06.385417 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:06.385638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:06.386294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:06.386294 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:06.386294 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:06.386294 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:06.386294 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:06.386294 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:06.386294 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:06.386294 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:06.387386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:06.387386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:06.387386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:06.387386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:06.387386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:06.387386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:06.387386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:06.387386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:06.387386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:06.387386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:06.387386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:06.387386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:06.387386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:06.387386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:47:06.387386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:06.387386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:06.387386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:06.387875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:10.943606 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:10.945470 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:10.982726 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:10.983177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:10.984038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:47:10.984038 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:10.984038 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:10.984038 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:10.984038 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:10.984038 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:10.984038 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:10.984038 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:10.984939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:10.984939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:10.984939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:10.984939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:10.984939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:10.984939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:10.984939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:10.984939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:10.984939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:10.984939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:10.984939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:10.984939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:10.984939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:10.984939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:47:10.984939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:10.984939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:10.984939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:10.985847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:10.986749 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:10.988743 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:10.989113 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:10.989371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:10.990329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:47:10.990329 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:10.990329 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:10.990329 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:10.990329 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:10.990329 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:10.990329 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:10.990329 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:10.991548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:10.991548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:10.991548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:10.991548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:10.991548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:10.991548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:10.991548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:10.991548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:10.991548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:10.991548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:10.991548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:10.991548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:10.991548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:10.991548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:47:10.991548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:10.991548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:10.991997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:11.068103 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:11.068611 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:47:11.069294 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:11.069525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:11.070144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:11.070144 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:11.070144 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:11.070144 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:11.070144 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:11.070144 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:11.070144 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:11.070144 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:11.071020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:11.071020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:11.071020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:11.071020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:11.071020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:11.071020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:11.071020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:11.071020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:11.071020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:11.071020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:11.071020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:11.071020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:11.071020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:11.071020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:11.071020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:11.071020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:11.071750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:11.071750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:11.071750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:11.071750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:11.071750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:11.071750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:11.071750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:11.071750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:11.071750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:11.071750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:11.071750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:11.071750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:11.071750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:11.071750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:11.071750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:11.071750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:11.072461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:11.073318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:11.073318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:11.073318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:11.073318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:11.073318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:11.073318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:11.073318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:11.073318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:11.073318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:11.073318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:11.073318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:11.322949 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:11.323634 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:11.324234 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:11.324529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:11.325415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:47:11.325415 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:11.325415 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:11.325415 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:11.325415 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:11.325415 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:11.325415 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:11.325415 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:11.326214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:11.326214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:11.326214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:11.326214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:11.326214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:11.326214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:11.326214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:11.326214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:11.326214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:11.326214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:11.326214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:11.326214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:11.326214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:11.326214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:11.326214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:11.327237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:11.327237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:11.327237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:11.327237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:11.327237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:11.327237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:11.327237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:11.327237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:11.327237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:11.327711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:11.327711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:11.327711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:11.327711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:11.327711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:11.327711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:11.327711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:11.327711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:11.327711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:11.327711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:11.327711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:11.327711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:11.327711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:11.327711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:47:11.327711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:47:11.327711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:11.328610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:11.329774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:11.329774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:11.384683 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:11.384970 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:11.385818 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:11.386274 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:11.386523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:11.387326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:11.387326 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:11.387326 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:11.387326 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:11.387326 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:11.387326 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:11.387326 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:11.387326 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:11.388546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:11.388546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:11.388546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:11.388546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:11.388546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:11.388546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:11.388546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:11.388546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:11.388546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:11.388546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:11.388546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:11.388546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:11.388546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:11.388546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:47:11.388546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:11.388546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:11.388546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:11.389237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:15.944488 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:15.946325 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:15.987479 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:16.008031 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:16.008031 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:16.008031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.008031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:47:16.008031 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:16.008031 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:16.008031 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:16.008031 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:16.008031 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:16.008031 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.008031 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:16.008031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:16.009620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:16.010905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:16.010905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:16.010905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:16.010905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:16.010905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:16.010905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:16.010905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:16.010905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:16.010905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:16.010905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:16.010905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:16.010905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:16.010905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.010905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:16.068785 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:16.069355 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:47:16.070195 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:16.070525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.071370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:16.071370 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:16.071370 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:16.071370 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:16.071370 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:16.071370 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:16.071370 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.071370 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:16.072264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.072264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:16.072264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:16.072264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:16.072264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:16.072264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:16.072264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:16.072264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:16.072264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:16.072264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:16.072264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:16.072264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:16.072264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:16.072264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:16.072264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:16.072264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:16.073125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:16.073125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:16.073125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:16.073125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:16.073125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:16.073125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:16.073125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.073125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:16.073472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.073472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:16.073472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:16.073472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:16.073472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:16.073472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:16.073472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:16.073472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:16.073472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:16.073472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:16.073472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:16.073472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:16.073472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:16.073472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:47:16.073472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:47:16.073472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:16.074138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:16.074911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:16.074911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.074911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:16.119516 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=248 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:47:16.137018 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:16.137449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.138342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Traceback (most recent call last):
Apr 07 19:47:16.138342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:16.138342 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:16.138342 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:16.138342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:16.138342 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:16.138342 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.138342 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:16.139504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-64112950-4bb3-4aa7-94d3-071000228d46 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.139504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:16.139504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:16.139504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:16.139504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:16.139504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:16.139504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:16.139504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:16.139504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:16.139504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:16.139504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:16.139504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:16.139504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:16.139504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:47:16.139504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:16.139504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:16.139504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.140090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:16.323918 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:16.324277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:16.324851 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:16.325923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.326961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:47:16.326961 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:16.326961 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:16.326961 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:16.326961 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:16.326961 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:16.326961 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.326961 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:16.328397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.328397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:16.328397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:16.328397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:16.328397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:16.328397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:16.328397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:16.328397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:16.328397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:16.328397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:16.328397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:16.328397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:16.328397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:16.328397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:16.328397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:16.329214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:16.329214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:16.329214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:16.329214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:16.329214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:16.329214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:16.329214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:16.329214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.329214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:16.330379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.330379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:16.330379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:16.330379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:16.330379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:16.330379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:16.330379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:16.330379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:16.330379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:16.330379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:16.330379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:16.330379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:16.330379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:16.330379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:47:16.330379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:47:16.330379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:16.355963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:16.356468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.356468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:16.385151 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:16.385361 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:16.385870 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:16.386320 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:16.386565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.387303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:16.387303 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:16.387303 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:16.387303 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:16.387303 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:16.387303 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:16.387303 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.387303 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:16.388224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.388224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:16.388224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:16.388224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:16.388224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:16.388224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:16.388224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:16.388224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:16.388224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:16.388224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:16.388224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:16.388224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:16.388224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:16.388224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:47:16.388224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:16.388224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:16.388224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:16.389319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:20.945166 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:20.946820 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:20.987663 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:20.987934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:20.988548 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:20.989849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:47:20.989849 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:20.989849 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:20.989849 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:20.989849 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:20.989849 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:20.989849 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:20.989849 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:20.990811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:20.990811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:20.990811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:20.990811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:20.990811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:20.990811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:20.990811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:20.990811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:20.990811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:20.990811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:20.990811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:20.990811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:20.990811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:20.990811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:47:20.990811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:20.990811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:20.990811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:20.992971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:20.993745 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:20.993745 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:20.993745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:20.993745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:47:20.993745 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:20.993745 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:20.993745 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:20.993745 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:20.993745 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:20.993745 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:20.993745 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:20.994657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:20.994657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:20.994657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:20.994657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:20.994657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:20.994657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:20.994657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:20.994657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:20.994657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:20.994657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:20.994657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:20.994657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:20.994657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:20.994657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:47:20.994657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:20.994657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:20.995699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:21.069422 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:21.070188 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:47:21.070646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:21.070846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:21.071465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:21.071465 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:21.071465 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:21.071465 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:21.071465 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:21.071465 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:21.071465 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:21.071465 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:21.072767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:21.072767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:21.072767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:21.072767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:21.072767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:21.072767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:21.072767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:21.072767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:21.072767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:21.072767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:21.072767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:21.072767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:21.072767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:21.072767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:21.072767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:21.072767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:21.073543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:21.073543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:21.073543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:21.073543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:21.073543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:21.073543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:21.073543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:21.073543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:21.074374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:21.074374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:21.074374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:21.074374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:21.074374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:21.074374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:21.074374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:21.074374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:21.074374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:21.074374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:21.074374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:21.074374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:21.074374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:21.074374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:47:21.074374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:47:21.074374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:21.075084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:21.076017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:21.076017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:21.076017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:21.324480 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:21.324897 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:21.325736 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:21.326213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:21.327282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:47:21.327282 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:21.327282 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:21.327282 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:21.327282 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:21.327282 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:21.327282 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:21.327282 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:21.328772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:21.328772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:21.328772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:21.328772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:21.328772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:21.328772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:21.328772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:21.328772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:21.328772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:21.328772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:21.328772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:21.328772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:21.328772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:21.328772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:21.328772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:21.329408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:21.329408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:21.329408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:21.329408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:21.329408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:21.329408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:21.329408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:21.329408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:21.329408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:21.331085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:21.331085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:21.331085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:21.331085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:21.331085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:21.331085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:21.331085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:21.331085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:21.331085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:21.331085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:21.331085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:21.331085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:21.331085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:21.331085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:47:21.331085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:47:21.331085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:21.331867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:21.332767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:21.332767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:21.385751 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:21.386183 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:21.386738 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:21.387246 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:21.387536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:21.388464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:21.388464 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:21.388464 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:21.388464 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:21.388464 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:21.388464 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:21.388464 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:21.388464 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:21.389414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:21.389414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:21.389414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:21.389414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:21.389414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:21.389414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:21.389414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:21.389414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:21.389414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:21.389414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:21.389414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:21.389414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:21.389414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:21.389414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:47:21.389414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:21.389414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:21.389414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:21.390336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:25.945860 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:25.946601 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:25.981895 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:25.982095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:25.982794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:47:25.982794 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:25.982794 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:25.982794 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:25.982794 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:25.982794 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:25.982794 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:25.982794 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:25.983823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:25.983823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:25.983823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:25.983823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:25.983823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:25.983823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:25.983823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:25.983823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:25.983823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:25.983823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:25.983823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:25.983823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:25.983823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:25.983823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:47:25.983823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:25.983823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:25.983823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:25.984327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:25.988955 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:25.989796 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:25.990033 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:25.990186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:25.990917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:47:25.990917 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:25.990917 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:25.990917 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:25.990917 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:25.990917 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:25.990917 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:25.990917 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:25.992151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:25.992151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:25.992151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:25.992151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:25.992151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:25.992151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:25.992151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:25.992151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:25.992151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:25.992151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:25.992151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:25.992151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:25.992151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:25.992151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:47:25.992151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:25.992151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:25.992498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:26.070457 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:26.071293 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:47:26.072069 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:26.072293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:26.072972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:26.072972 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:26.072972 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:26.072972 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:26.072972 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:26.072972 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:26.072972 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:26.072972 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:26.074676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:26.074676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:26.074676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:26.074676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:26.074676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:26.074676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:26.074676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:26.074676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:26.074676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:26.074676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:26.074676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:26.074676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:26.074676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:26.074676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:26.074676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:26.074676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:26.075907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:26.075907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:26.075907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:26.075907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:26.075907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:26.075907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:26.075907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:26.075907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:26.076520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:26.076520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:26.076520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:26.076520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:26.076520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:26.076520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:26.076520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:26.076520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:26.076520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:26.076520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:26.076520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:26.076520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:26.076520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:26.076520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:47:26.076520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:47:26.076520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:26.077182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:26.077805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:26.077805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:26.077805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:26.325130 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:26.325597 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:26.326048 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:26.326332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:26.326924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:47:26.326924 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:26.326924 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:26.326924 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:26.326924 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:26.326924 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:26.326924 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:26.326924 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:26.327662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:26.327662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:26.327662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:26.327662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:26.327662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:26.327662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:26.327662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:26.327662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:26.327662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:26.327662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:26.327662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:26.327662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:26.327662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:26.327662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:26.327662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:26.328391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:26.328391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:26.328391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:26.328391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:26.328391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:26.328391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:26.328391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:26.328391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:26.328391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:26.328770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:26.328770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:26.328770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:26.328770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:26.328770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:26.328770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:26.328770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:26.328770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:26.328770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:26.328770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:26.328770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:26.328770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:26.328770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:26.328770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:47:26.328770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:47:26.328770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:26.329543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:26.330378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:26.330378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:26.386409 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:26.387148 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:26.387552 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:26.387834 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:26.387946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:26.388687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:26.388687 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:26.388687 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:26.388687 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:26.388687 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:26.388687 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:26.388687 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:26.388687 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:26.391211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:26.391211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:26.391211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:26.391211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:26.391211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:26.391211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:26.391211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:26.391211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:26.391211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:26.391211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:26.391211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:26.391211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:26.391211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:26.391211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:47:26.391211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:26.391211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:26.391211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:26.392455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:30.946503 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:30.958459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:30.986688 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:30.987112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:30.988068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:47:30.988068 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:30.988068 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:30.988068 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:30.988068 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:30.988068 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:30.988068 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:30.988068 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:30.989207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:30.989207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:30.989207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:30.989207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:30.989207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:30.989207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:30.989207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:30.989207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:30.989207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:30.989207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:30.989207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:30.989207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:30.989207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:30.989207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:47:30.989207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:30.989207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:30.989207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:30.989913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:30.990707 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:30.990707 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:30.991117 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:30.991345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:30.992093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:47:30.992093 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:30.992093 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:30.992093 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:30.992093 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:30.992093 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:30.992093 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:30.992093 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:30.992842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:30.992842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:30.992842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:30.992842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:30.992842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:30.992842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:30.992842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:30.992842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:30.992842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:30.992842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:30.992842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:30.992842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:30.992842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:30.992842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:47:30.992842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:30.992842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:30.993543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:31.071247 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:31.071561 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:47:31.072331 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:31.072641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:31.073462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:31.073462 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:31.073462 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:31.073462 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:31.073462 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:31.073462 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:31.073462 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:31.073462 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:31.074793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:31.074793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:31.074793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:31.074793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:31.074793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:31.074793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:31.074793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:31.074793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:31.074793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:31.074793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:31.074793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:31.074793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:31.074793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:31.074793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:31.074793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:31.074793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:31.075789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:31.075789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:31.075789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:31.075789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:31.075789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:31.075789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:31.075789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:31.075789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:31.076414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:31.076414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:31.076414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:31.076414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:31.076414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:31.076414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:31.076414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:31.076414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:31.076414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:31.076414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:31.076414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:31.076414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:31.076414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:31.076414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:47:31.076414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:47:31.076414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:31.077255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:31.077843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:31.077843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:31.077843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:31.325736 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:31.326511 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:31.327271 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:31.327685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:31.328532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:47:31.328532 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:31.328532 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:31.328532 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:31.328532 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:31.328532 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:31.328532 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:31.328532 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:31.329468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:31.329468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:31.329468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:31.329468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:31.329468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:31.329468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:31.329468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:31.329468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:31.329468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:31.329468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:31.329468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:31.329468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:31.329468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:31.329468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:31.329468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:31.330313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:31.330313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:31.330313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:31.330313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:31.330313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:31.330313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:31.330313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:31.330313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:31.330313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:31.330871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:31.330871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:31.330871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:31.330871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:31.330871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:31.330871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:31.330871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:31.330871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:31.330871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:31.330871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:31.330871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:31.330871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:31.330871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:31.330871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:47:31.330871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:47:31.330871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:31.331437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:31.332147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:31.332147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:31.387154 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:31.387758 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:31.388493 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:31.388894 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:31.389145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:31.390066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:31.390066 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:31.390066 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:31.390066 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:31.390066 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:31.390066 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:31.390066 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:31.390066 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:31.391892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:31.391892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:31.391892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:31.391892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:31.391892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:31.391892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:31.391892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:31.391892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:31.391892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:31.391892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:31.391892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:31.391892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:31.391892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:31.391892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:47:31.391892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:31.391892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:31.391892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:31.392843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:35.947554 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:35.948488 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:35.987540 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:35.987817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:35.988552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:47:35.988552 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:35.988552 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:35.988552 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:35.988552 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:35.988552 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:35.988552 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:35.988552 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:35.989865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:35.989865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:35.989865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:35.989865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:35.989865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:35.989865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:35.989865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:35.989865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:35.989865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:35.989865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:35.989865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:35.989865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:35.989865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:35.989865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:47:35.989865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:35.989865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:35.989865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:35.990272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:35.990666 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:35.991042 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:35.991228 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:35.991380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:35.992039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:47:35.992039 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:35.992039 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:35.992039 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:35.992039 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:35.992039 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:35.992039 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:35.992039 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:35.993314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:35.993314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:35.993314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:35.993314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:35.993314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:35.993314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:35.993314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:35.993314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:35.993314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:35.993314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:35.993314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:35.993314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:35.993314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:35.993314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:47:35.993314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:35.993314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:35.994118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:36.071768 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:36.072248 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:47:36.072704 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:36.072934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:36.073709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:36.073709 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:36.073709 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:36.073709 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:36.073709 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:36.073709 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:36.073709 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:36.073709 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:36.075019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:36.075019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:36.075019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:36.075019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:36.075019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:36.075019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:36.075019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:36.075019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:36.075019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:36.075019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:36.075019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:36.075019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:36.075019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:36.075019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:36.075019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:36.075019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:36.075896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:36.075896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:36.075896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:36.075896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:36.075896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:36.075896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:36.075896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:36.075896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:36.077211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:36.077211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:36.077211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:36.077211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:36.077211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:36.077211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:36.077211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:36.077211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:36.077211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:36.077211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:36.077211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:36.077211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:36.077211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:36.077211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:47:36.077211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:47:36.077211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:36.077773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:36.078284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:36.078284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:36.078284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:36.326282 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:36.326949 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:36.327445 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:36.327742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:36.328441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:47:36.328441 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:36.328441 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:36.328441 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:36.328441 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:36.328441 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:36.328441 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:36.328441 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:36.329908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:36.329908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:36.329908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:36.329908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:36.329908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:36.329908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:36.329908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:36.329908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:36.329908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:36.329908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:36.329908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:36.329908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:36.329908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:36.329908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:36.329908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:36.330359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:36.330359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:36.330359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:36.330359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:36.330359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:36.330359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:36.330359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:36.330359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:36.330359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:36.332053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:36.332053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:36.332053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:36.332053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:36.332053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:36.332053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:36.332053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:36.332053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:36.332053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:36.332053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:36.332053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:36.332053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:36.332053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:36.332053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:47:36.332053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:47:36.332053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:36.332534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:36.333076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:36.333076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:36.387773 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:36.388311 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:36.388782 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:36.389078 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:36.389194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:36.389917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:36.389917 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:36.389917 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:36.389917 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:36.389917 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:36.389917 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:36.389917 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:36.389917 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:36.392025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:36.392025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:36.392025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:36.392025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:36.392025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:36.392025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:36.392025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:36.392025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:36.392025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:36.392025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:36.392025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:36.392025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:36.392025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:36.392025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:47:36.392025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:36.392025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:36.392025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:36.392882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:40.947895 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:40.948845 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:40.985758 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:40.986052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:40.986765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:47:40.986765 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:40.986765 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:40.986765 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:40.986765 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:40.986765 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:40.986765 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:40.986765 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:40.988085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:40.988085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:40.988085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:40.988085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:40.988085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:40.988085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:40.988085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:40.988085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:40.988085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:40.988085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:40.988085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:40.988085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:40.988085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:40.988085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:47:40.988085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:40.988085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:40.988085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:40.989116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:40.990626 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:40.991415 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:40.991618 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:40.991824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:40.992439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:47:40.992439 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:40.992439 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:40.992439 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:40.992439 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:40.992439 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:40.992439 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:40.992439 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:40.993965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:40.993965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:40.993965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:40.993965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:40.993965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:40.993965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:40.993965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:40.993965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:40.993965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:40.993965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:40.993965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:40.993965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:40.993965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:40.993965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:47:40.993965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:40.993965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:40.994760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:41.072313 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:41.072733 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:47:41.073187 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:41.073396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:41.073953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:41.073953 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:41.073953 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:41.073953 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:41.073953 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:41.073953 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:41.073953 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:41.073953 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:41.074780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:41.074780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:41.074780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:41.074780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:41.074780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:41.074780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:41.074780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:41.074780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:41.074780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:41.074780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:41.074780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:41.074780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:41.074780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:41.074780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:41.074780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:41.074780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:41.075482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:41.075482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:41.075482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:41.075482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:41.075482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:41.075482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:41.075482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:41.075482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:41.075482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:41.075482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:41.075482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:41.075482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:41.075482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:41.075482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:41.075482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:41.075482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:41.076204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:41.077114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:41.077114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:41.077114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:41.077114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:41.077114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:41.077114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:41.077114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:41.077114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:41.077114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:41.077114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:41.077114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:41.326978 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:41.327339 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:41.327907 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:41.328414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:41.329154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:47:41.329154 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:41.329154 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:41.329154 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:41.329154 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:41.329154 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:41.329154 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:41.329154 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:41.329833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:41.329833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:41.329833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:41.329833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:41.329833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:41.329833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:41.329833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:41.329833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:41.329833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:41.329833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:41.329833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:41.329833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:41.329833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:41.329833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:41.329833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:41.330691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:41.330691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:41.330691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:41.330691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:41.330691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:41.330691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:41.330691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:41.330691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:41.330691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:41.331228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:41.331228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:41.331228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:41.331228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:41.331228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:41.331228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:41.331228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:41.331228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:41.331228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:41.331228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:41.331228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:41.331228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:41.331228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:41.331228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:47:41.331228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:47:41.331228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:41.331720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:41.332324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:41.332324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:41.388321 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:41.388684 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:41.389219 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:41.389464 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:41.389615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:41.390239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:41.390239 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:41.390239 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:41.390239 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:41.390239 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:41.390239 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:41.390239 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:41.390239 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:41.391886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:41.391886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:41.391886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:41.391886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:41.391886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:41.391886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:41.391886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:41.391886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:41.391886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:41.391886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:41.391886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:41.391886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:41.391886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:41.391886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:47:41.391886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:41.391886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:41.391886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:41.392397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:45.948438 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:45.949819 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:45.990363 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:45.990694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:45.991155 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:45.991867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:47:45.991867 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:45.991867 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:45.991867 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:45.991867 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:45.991867 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:45.991867 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:45.991867 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:45.993480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:45.993480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:45.993480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:45.993480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:45.993480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:45.993480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:45.993480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:45.993480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:45.993480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:45.993480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:45.993480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:45.993480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:45.993480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:45.993480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:47:45.993480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:45.993480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:45.993480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:45.994308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:45.995208 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:45.995208 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:45.995208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:45.995208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:47:45.995208 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:45.995208 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:45.995208 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:45.995208 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:45.995208 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:45.995208 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:45.995208 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:45.996323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:45.996323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:45.996323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:45.996323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:45.996323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:45.996323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:45.996323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:45.996323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:45.996323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:45.996323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:45.996323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:45.996323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:45.996323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:45.996323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:47:45.996323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:45.996323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:45.996996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:46.072942 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:46.073485 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:47:46.074208 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:46.074440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:46.075534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:46.075534 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:46.075534 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:46.075534 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:46.075534 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:46.075534 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:46.075534 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:46.075534 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:46.077095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:46.077095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:46.077095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:46.077095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:46.077095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:46.077095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:46.077095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:46.077095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:46.077095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:46.077095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:46.077095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:46.077095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:46.077095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:46.077095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:46.077095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:46.077095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:46.077747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:46.077747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:46.077747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:46.077747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:46.077747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:46.077747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:46.077747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:46.077747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:46.079729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:46.079729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:46.079729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:46.079729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:46.079729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:46.079729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:46.079729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:46.079729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:46.079729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:46.079729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:46.079729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:46.079729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:46.079729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:46.079729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:47:46.079729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:47:46.079729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:46.080369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:46.080971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:46.080971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:46.080971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:46.327650 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:46.328092 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:46.328424 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:46.328626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:46.329095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:47:46.329095 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:46.329095 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:46.329095 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:46.329095 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:46.329095 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:46.329095 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:46.329095 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:46.329912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:46.329912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:46.329912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:46.329912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:46.329912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:46.329912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:46.329912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:46.329912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:46.329912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:46.329912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:46.329912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:46.329912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:46.329912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:46.329912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:46.329912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:46.330431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:46.330431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:46.330431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:46.330431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:46.330431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:46.330431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:46.330431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:46.330431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:46.330431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:46.331187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:46.331187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:46.331187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:46.331187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:46.331187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:46.331187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:46.331187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:46.331187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:46.331187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:46.331187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:46.331187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:46.331187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:46.331187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:46.331187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:47:46.331187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:47:46.331187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:46.331714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:46.332288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:46.332288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:46.389132 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:46.389399 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:46.389869 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:46.390298 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:46.390561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:46.391403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:46.391403 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:46.391403 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:46.391403 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:46.391403 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:46.391403 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:46.391403 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:46.391403 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:46.392438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:46.392438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:46.392438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:46.392438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:46.392438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:46.392438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:46.392438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:46.392438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:46.392438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:46.392438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:46.392438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:46.392438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:46.392438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:46.392438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:47:46.392438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:46.392438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:46.392438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:46.393059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:50.949350 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:50.951133 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:50.989914 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:50.990346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:50.991311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:47:50.991311 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:50.991311 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:50.991311 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:50.991311 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:50.991311 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:50.991311 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:50.991311 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:50.992350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:50.992350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:50.992350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:50.992350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:50.992350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:50.992350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:50.992350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:50.992350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:50.992350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:50.992350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:50.992350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:50.992350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:50.992350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:50.992350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:47:50.992350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:50.992350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:50.992350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:50.993257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:50.995340 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:50.995340 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:50.995340 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:50.995340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:50.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:47:50.995623 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:50.995623 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:50.995623 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:50.995623 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:50.995623 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:50.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:50.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:50.997277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:50.997277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:50.997277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:50.997277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:50.997277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:50.997277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:50.997277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:50.997277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:50.997277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:50.997277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:50.997277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:50.997277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:50.997277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:50.997277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:47:50.997277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:50.997277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:50.998315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:51.073779 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:51.074321 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:47:51.074889 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:51.075279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:51.076091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:51.076091 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:51.076091 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:51.076091 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:51.076091 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:51.076091 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:51.076091 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:51.076091 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:51.077324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:51.077324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:51.077324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:51.077324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:51.077324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:51.077324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:51.077324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:51.077324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:51.077324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:51.077324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:51.077324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:51.077324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:51.077324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:51.077324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:51.077324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:51.077324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:51.077973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:51.077973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:51.077973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:51.077973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:51.077973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:51.077973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:51.077973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:51.077973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:51.078776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:51.078776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:51.078776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:51.078776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:51.078776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:51.078776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:51.078776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:51.078776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:51.078776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:51.078776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:51.078776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:51.078776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:51.078776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:51.078776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:47:51.078776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:47:51.078776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:51.079228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:51.079771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:51.079771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:51.079771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:51.328267 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:51.328846 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:51.329395 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:51.329809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:51.330666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:47:51.330666 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:51.330666 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:51.330666 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:51.330666 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:51.330666 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:51.330666 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:51.330666 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:51.331920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:51.331920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:51.331920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:51.331920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:51.331920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:51.331920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:51.331920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:51.331920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:51.331920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:51.331920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:51.331920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:51.331920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:51.331920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:51.331920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:51.331920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:51.332485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:51.332485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:51.332485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:51.332485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:51.332485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:51.332485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:51.332485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:51.332485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:51.332485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:51.333417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:51.333417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:51.333417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:51.333417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:51.333417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:51.333417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:51.333417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:51.333417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:51.333417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:51.333417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:51.333417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:51.333417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:51.333417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:51.333417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:47:51.333417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:47:51.333417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:51.333937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:51.334474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:51.334474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:51.389684 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:51.401940 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:51.401940 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:51.401940 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:51.401940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:51.401940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:51.401940 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:51.401940 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:51.401940 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:51.401940 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:51.401940 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:51.401940 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:51.401940 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:51.402656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:51.402656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:51.402656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:51.402656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:51.402656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:51.402656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:51.402656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:51.402656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:51.402656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:51.402656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:51.402656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:51.402656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:51.402656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:51.402656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:47:51.402656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:51.402656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:51.402656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:51.403578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:55.950128 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:55.951115 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:55.991026 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:55.991293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:55.992052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:47:55.992052 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:55.992052 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:55.992052 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:55.992052 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:55.992052 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:55.992052 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:55.992052 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:55.993301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:55.993301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:55.993301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:55.993301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:55.993301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:55.993301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:55.993301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:55.993301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:55.993301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:55.993301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:55.993301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:55.993301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:55.993301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:55.993301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:47:55.993301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:55.993301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:55.993301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:55.994702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:55.995755 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:55.995755 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:55.995755 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:55.996025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:55.996957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:47:55.996957 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:55.996957 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:55.996957 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:55.996957 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:55.996957 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:55.996957 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:55.996957 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:55.998849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:55.998849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:55.998849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:55.998849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:55.998849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:55.998849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:55.998849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:55.998849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:55.998849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:55.998849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:55.998849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:55.998849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:55.998849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:55.998849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:47:55.998849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:55.998849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:55.999730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:56.074612 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:56.074862 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:47:56.075666 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:56.076012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:56.076866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:56.076866 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:56.076866 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:56.076866 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:56.076866 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:56.076866 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:56.076866 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:56.076866 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:56.078219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:56.078219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:56.078219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:56.078219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:56.078219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:56.078219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:56.078219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:56.078219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:56.078219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:56.078219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:56.078219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:56.078219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:56.078219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:56.078219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:56.078219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:56.078219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:56.079407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:56.079407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:56.079407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:56.079407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:56.079407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:56.079407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:56.079407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:56.079407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:56.080119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:56.080119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:56.080119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:56.080119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:56.080119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:56.080119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:56.080119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:56.080119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:56.080119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:56.080119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:56.080119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:56.080119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:56.080119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:56.080119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:47:56.080119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:47:56.080119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:56.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:56.082377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:56.082377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:56.082377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:56.328864 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:56.329393 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:56.329808 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:56.330220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:56.330579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:47:56.330579 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:56.330579 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:56.330579 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:56.330579 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:56.330579 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:56.330579 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:56.330579 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:56.331239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:56.331239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:47:56.331239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:56.331239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:56.331239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:56.331239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:56.331239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:56.331239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:56.331239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:56.331239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:47:56.331239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:56.331239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:47:56.331239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:56.331239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:47:56.331239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:47:56.331789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:56.331789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:47:56.331789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:56.331789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:47:56.331789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:47:56.331789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:56.331789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:47:56.331789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:56.331789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:47:56.332112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:56.332112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:56.332112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:56.332112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:56.332112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:56.332112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:56.332112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:56.332112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:56.332112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:56.332112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:56.332112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:56.332112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:56.332112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:56.332112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:47:56.332112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:47:56.332112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:56.332585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:56.333324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:56.333324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:47:56.390338 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:47:56.390589 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:47:56.391074 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:56.391480 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:47:56.391737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:56.392536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:47:56.392536 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:56.392536 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:47:56.392536 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:47:56.392536 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:56.392536 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:47:56.392536 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:56.392536 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:47:56.393754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:56.393754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:47:56.393754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:47:56.393754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:47:56.393754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:47:56.393754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:47:56.393754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:56.393754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:47:56.393754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:47:56.393754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:47:56.393754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:47:56.393754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:47:56.393754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:47:56.393754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:47:56.393754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:47:56.393754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:56.393754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:47:56.394802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:00.950792 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:00.952407 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:00.987773 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:00.988267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:00.989180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:48:00.989180 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:00.989180 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:00.989180 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:00.989180 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:00.989180 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:00.989180 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:00.989180 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:00.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:00.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:00.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:00.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:00.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:00.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:00.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:00.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:00.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:00.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:00.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:00.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:00.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:00.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:48:00.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:00.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:00.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:00.991611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:00.995594 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:00.996770 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:00.997007 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:00.997313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:00.998219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:48:00.998219 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:00.998219 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:00.998219 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:00.998219 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:00.998219 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:00.998219 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:00.998219 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:00.999485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:00.999485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:00.999485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:00.999485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:00.999485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:00.999485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:00.999485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:00.999485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:00.999485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:00.999485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:00.999485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:00.999485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:00.999485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:00.999485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:48:00.999485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:00.999485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:00.999962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:01.075335 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:01.076245 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:48:01.077330 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:01.077696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:01.078732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:01.078732 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:01.078732 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:01.078732 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:01.078732 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:01.078732 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:01.078732 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:01.078732 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:01.080066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:01.080066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:01.080066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:01.080066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:01.080066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:01.080066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:01.080066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:01.080066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:01.080066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:01.080066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:01.080066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:01.080066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:01.080066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:01.080066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:01.080066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:01.080066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:01.080884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:01.080884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:01.080884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:01.080884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:01.080884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:01.080884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:01.080884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:01.080884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:01.081312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:01.081312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:01.081312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:01.081312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:01.081312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:01.081312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:01.081312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:01.081312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:01.081312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:01.081312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:01.081312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:01.081312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:01.081312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:01.081312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:48:01.081312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:48:01.081312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:01.082133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:01.083255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:01.083255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:01.083255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:01.329864 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:01.330840 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:01.332127 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:01.332538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:01.333234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:48:01.333234 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:01.333234 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:01.333234 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:01.333234 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:01.333234 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:01.333234 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:01.333234 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:01.334145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:01.334145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:01.334145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:01.334145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:01.334145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:01.334145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:01.334145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:01.334145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:01.334145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:01.334145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:01.334145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:01.334145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:01.334145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:01.334145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:01.334145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:01.334592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:01.334592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:01.334592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:01.334592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:01.334592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:01.334592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:01.334592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:01.334592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:01.334592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:01.335184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:01.335184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:01.335184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:01.335184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:01.335184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:01.335184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:01.335184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:01.335184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:01.335184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:01.335184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:01.335184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:01.335184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:01.335184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:01.335184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:48:01.335184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:48:01.335184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:01.335640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:01.336223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:01.336223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:01.390776 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:01.391105 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:01.391535 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:01.391860 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:01.392084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:01.392651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:01.392651 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:01.392651 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:01.392651 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:01.392651 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:01.392651 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:01.392651 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:01.392651 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:01.393687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:01.393687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:01.393687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:01.393687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:01.393687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:01.393687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:01.393687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:01.393687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:01.393687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:01.393687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:01.393687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:01.393687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:01.393687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:01.393687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:48:01.393687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:01.393687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:01.393687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:01.394415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:05.951398 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:05.954017 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:05.998176 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:06.005187 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:06.005813 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:06.006241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.008431 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:06.008782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.009543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:48:06.009543 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:06.009543 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:06.009543 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:06.009543 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:06.009543 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:06.009543 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.009543 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:06.010086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:48:06.010086 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:06.010086 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:06.010086 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:06.010086 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:06.010086 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:06.010086 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.010086 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:06.011865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.011865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:06.011865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:06.011865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:06.011865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:06.011865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:06.011865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:06.011865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:06.011865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:06.011865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:06.011865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:06.011865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:06.011865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:06.011865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:48:06.011865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:06.011865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:06.011865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.012651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:06.013594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.013594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:06.013594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:06.013594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:06.013594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:06.013594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:06.013594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:06.013594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:06.013594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:06.013594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:06.013594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:06.013594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:06.013594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:06.013594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:48:06.013594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:06.013594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.014429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:06.076159 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:06.076636 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:48:06.077470 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:06.077957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.079149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:06.079149 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:06.079149 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:06.079149 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:06.079149 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:06.079149 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:06.079149 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.079149 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:06.081426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.081426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:06.081426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:06.081426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:06.081426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:06.081426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:06.081426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:06.081426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:06.081426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:06.081426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:06.081426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:06.081426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:06.081426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:06.081426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:06.081426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:06.081426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:06.083359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:06.083359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:06.083359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:06.083359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:06.083359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:06.083359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:06.083359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.083359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:06.083952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.083952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:06.083952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:06.083952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:06.083952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:06.083952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:06.083952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:06.083952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:06.083952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:06.083952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:06.083952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:06.083952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:06.083952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:06.083952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:48:06.083952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:48:06.083952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:06.084634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:06.085630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:06.085630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.085630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:06.330572 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:06.331186 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:06.332312 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:06.332856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.334122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:48:06.334122 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:06.334122 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:06.334122 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:06.334122 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:06.334122 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:06.334122 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.334122 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:06.335886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.335886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:06.335886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:06.335886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:06.335886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:06.335886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:06.335886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:06.335886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:06.335886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:06.335886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:06.335886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:06.335886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:06.335886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:06.335886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:06.335886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:06.337020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:06.337020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:06.337020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:06.337020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:06.337020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:06.337020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:06.337020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:06.337020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.337020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:06.338095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.338095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:06.338095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:06.338095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:06.338095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:06.338095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:06.338095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:06.338095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:06.338095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:06.338095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:06.338095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:06.338095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:06.338095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:06.338095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:48:06.338095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:48:06.338095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:06.338856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:06.339416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.339416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:06.391528 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:06.392319 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:06.393161 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:06.393614 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:06.393864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.394655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:06.394655 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:06.394655 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:06.394655 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:06.394655 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:06.394655 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:06.394655 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.394655 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:06.396184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.396184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:06.396184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:06.396184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:06.396184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:06.396184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:06.396184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:06.396184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:06.396184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:06.396184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:06.396184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:06.396184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:06.396184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:06.396184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:48:06.396184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:06.396184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:06.396184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:06.396913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:10.952208 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:10.953389 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:10.992199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:10.992661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:10.993952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:48:10.993952 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:10.993952 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:10.993952 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:10.993952 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:10.993952 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:10.993952 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:10.993952 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:10.995351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:10.995351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:10.995351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:10.995351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:10.995351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:10.995351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:10.995351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:10.995351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:10.995351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:10.995351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:10.995351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:10.995351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:10.995351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:10.995351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:48:10.995351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:10.995351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:10.995351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:10.996241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:10.998853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:11.000397 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:11.000700 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:11.000934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.001796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:48:11.001796 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:11.001796 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:11.001796 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:11.001796 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:11.001796 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:11.001796 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.001796 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:11.003076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.003076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:11.003076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:11.003076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:11.003076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:11.003076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:11.003076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:11.003076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:11.003076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:11.003076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:11.003076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:11.003076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:11.003076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:11.003076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:48:11.003076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:11.003076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.003770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:11.076782 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:11.077088 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:48:11.078146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:11.078549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:11.081919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:11.082565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:11.082565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:11.082565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:11.082565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:11.082565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:11.082565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:11.082565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:11.082565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:11.082565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:11.082565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:11.082565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:11.082565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.082565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:11.082565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.082565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:11.083018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:11.083633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:11.083633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:11.083633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:11.083633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:11.083633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:11.083633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:11.083633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:11.083633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:11.083633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:11.083633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:11.083633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:11.083633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:11.083633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:11.083633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:11.083633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:11.083633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.083633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:11.331591 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:11.331964 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:11.332503 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:11.332821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.333515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:48:11.333515 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:11.333515 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:11.333515 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:11.333515 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:11.333515 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:11.333515 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.333515 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:11.334412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.334412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:11.334412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:11.334412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:11.334412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:11.334412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:11.334412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:11.334412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:11.334412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:11.334412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:11.334412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:11.334412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:11.334412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:11.334412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:11.334412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:11.334759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:11.334759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:11.334759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:11.334759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:11.334759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:11.334759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:11.334759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:11.334759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.334759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:11.335845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.335845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:11.335845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:11.335845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:11.335845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:11.335845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:11.335845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:11.335845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:11.335845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:11.335845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:11.335845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:11.335845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:11.335845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:11.335845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:48:11.335845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:48:11.335845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:11.336423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:11.336770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.336770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:11.392465 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:11.393027 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:11.393539 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:11.393890 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:11.394138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.394821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:11.394821 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:11.394821 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:11.394821 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:11.394821 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:11.394821 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:11.394821 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.394821 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:11.396512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.396512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:11.396512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:11.396512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:11.396512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:11.396512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:11.396512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:11.396512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:11.396512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:11.396512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:11.396512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:11.396512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:11.396512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:11.396512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:48:11.396512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:11.396512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:11.396512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:11.397044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:15.952905 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:15.954081 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:15.993481 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:15.993718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:15.994317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:48:15.994317 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:15.994317 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:15.994317 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:15.994317 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:15.994317 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:15.994317 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:15.994317 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:15.995636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:15.995636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:15.995636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:15.995636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:15.995636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:15.995636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:15.995636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:15.995636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:15.995636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:15.995636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:15.995636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:15.995636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:15.995636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:15.995636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:48:15.995636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:15.995636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:15.995636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:15.996653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:15.999584 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:16.000578 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:16.000798 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:16.000964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.001706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:48:16.001706 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:16.001706 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:16.001706 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:16.001706 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:16.001706 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:16.001706 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.001706 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:16.003005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.003005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:16.003005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:16.003005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:16.003005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:16.003005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:16.003005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:16.003005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:16.003005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:16.003005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:16.003005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:16.003005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:16.003005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:16.003005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:48:16.003005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:16.003005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.003477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:16.077413 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:16.077902 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:48:16.078593 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:16.078926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.079894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:16.079894 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:16.079894 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:16.079894 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:16.079894 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:16.079894 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:16.079894 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.079894 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:16.081190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.081190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:16.081190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:16.081190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:16.081190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:16.081190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:16.081190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:16.081190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:16.081190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:16.081190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:16.081190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:16.081190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:16.081190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:16.081190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:16.081190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:16.081190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:16.081975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:16.081975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:16.081975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:16.081975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:16.081975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:16.081975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:16.081975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.081975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:16.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:16.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:16.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:16.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:16.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:16.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:16.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:16.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:16.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:16.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:16.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:16.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:16.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:48:16.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:48:16.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:16.083576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:16.084441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:16.084441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.084441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:16.332340 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:16.333069 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:16.333601 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:16.334167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.335114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:48:16.335114 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:16.335114 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:16.335114 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:16.335114 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:16.335114 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:16.335114 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.335114 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:16.336970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.336970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:16.336970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:16.336970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:16.336970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:16.336970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:16.336970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:16.336970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:16.336970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:16.336970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:16.336970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:16.336970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:16.336970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:16.336970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:16.336970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:16.337737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:16.337737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:16.337737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:16.337737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:16.337737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:16.337737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:16.337737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:16.337737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.337737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:16.337737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.337737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:16.337737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:16.337737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:16.337737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:16.337737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:16.338343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:16.338928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:16.338928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:16.338928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:16.338928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:16.338928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:16.338928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:16.338928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:16.338928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:16.338928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:16.338928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:16.338928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.338928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:16.393097 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:16.393519 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:16.394076 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:16.394521 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:16.394779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.395579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:16.395579 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:16.395579 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:16.395579 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:16.395579 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:16.395579 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:16.395579 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.395579 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:16.397201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.397201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:16.397201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:16.397201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:16.397201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:16.397201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:16.397201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:16.397201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:16.397201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:16.397201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:16.397201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:16.397201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:16.397201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:16.397201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:48:16.397201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:16.397201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:16.397201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:16.397830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:20.953401 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:20.954701 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:20.956525 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=252 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:48:20.990478 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:20.990868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:20.991558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:48:20.991558 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:20.991558 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:20.991558 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:20.991558 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:20.991558 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:20.991558 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:20.991558 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:20.992582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:20.992582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:20.992582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:20.992582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:20.992582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:20.992582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:20.992582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:20.992582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:20.992582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:20.992582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:20.992582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:20.992582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:20.992582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:20.992582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:48:20.992582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:20.992582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:20.992582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:20.993527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:21.000298 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:21.001206 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:21.001475 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:21.001711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.002588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:48:21.002588 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:21.002588 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:21.002588 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:21.002588 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:21.002588 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:21.002588 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.002588 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:21.004599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.004599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:21.004599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:21.004599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:21.004599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:21.004599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:21.004599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:21.004599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:21.004599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:21.004599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:21.004599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:21.004599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:21.004599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:21.004599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:48:21.004599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:21.004599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.005380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:21.078155 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:21.078464 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:48:21.079344 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:21.079645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.080374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:21.080374 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:21.080374 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:21.080374 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:21.080374 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:21.080374 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:21.080374 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.080374 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:21.081288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.081288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:21.081288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:21.081288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:21.081288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:21.081288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:21.081288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:21.081288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:21.081288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:21.081288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:21.081288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:21.081288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:21.081288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:21.081288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:21.081288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:21.081288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:21.081943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:21.081943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:21.081943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:21.081943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:21.081943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:21.081943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:21.081943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.081943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:21.082293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.082293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:21.082293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:21.082293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:21.082293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:21.082293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:21.082293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:21.082293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:21.082293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:21.082293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:21.082293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:21.082293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:21.082293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:21.082293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:48:21.082293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:48:21.082293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:21.082898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:21.083563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:21.083563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.083563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:21.333129 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:21.333718 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:21.334404 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:21.334679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.335481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:48:21.335481 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:21.335481 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:21.335481 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:21.335481 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:21.335481 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:21.335481 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.335481 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:21.337058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.337058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:21.337058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:21.337058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:21.337058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:21.337058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:21.337058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:21.337058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:21.337058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:21.337058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:21.337058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:21.337058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:21.337058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:21.337058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:21.337058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:21.337852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:21.337852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:21.337852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:21.337852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:21.337852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:21.337852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:21.337852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:21.337852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.337852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:21.339214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.339214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:21.339214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:21.339214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:21.339214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:21.339214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:21.339214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:21.339214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:21.339214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:21.339214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:21.339214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:21.339214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:21.339214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:21.339214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:48:21.339214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:48:21.339214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:21.339709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:21.340384 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.340384 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:21.393745 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:21.394476 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:21.395008 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:21.395585 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:21.395912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.397142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:21.397142 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:21.397142 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:21.397142 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:21.397142 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:21.397142 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:21.397142 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.397142 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:21.399080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.399080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:21.399080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:21.399080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:21.399080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:21.399080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:21.399080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:21.399080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:21.399080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:21.399080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:21.399080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:21.399080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:21.399080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:21.399080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:48:21.399080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:21.399080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:21.399080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:21.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:25.954521 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:25.955625 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:25.991199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:25.991536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:25.992313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:48:25.992313 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:25.992313 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:25.992313 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:25.992313 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:25.992313 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:25.992313 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:25.992313 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:25.994441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:25.994441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:25.994441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:25.994441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:25.994441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:25.994441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:25.994441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:25.994441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:25.994441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:25.994441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:25.994441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:25.994441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:25.994441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:25.994441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:48:25.994441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:25.994441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:25.994441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:25.995623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:26.000761 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:26.001574 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:26.001758 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:26.001954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.002412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:48:26.002412 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:26.002412 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:26.002412 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:26.002412 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:26.002412 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:26.002412 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.002412 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:26.003441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.003441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:26.003441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:26.003441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:26.003441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:26.003441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:26.003441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:26.003441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:26.003441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:26.003441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:26.003441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:26.003441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:26.003441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:26.003441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:48:26.003441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:26.003441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.003936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:26.078777 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:26.079161 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:48:26.079733 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:26.079931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.080570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:26.080570 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:26.080570 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:26.080570 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:26.080570 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:26.080570 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:26.080570 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.080570 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:26.081893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.081893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:26.081893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:26.081893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:26.081893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:26.081893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:26.081893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:26.081893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:26.081893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:26.081893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:26.081893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:26.081893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:26.081893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:26.081893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:26.081893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:26.081893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:26.082495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:26.082495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:26.082495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:26.082495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:26.082495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:26.082495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:26.082495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.082495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:26.083761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.083761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:26.083761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:26.083761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:26.083761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:26.083761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:26.083761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:26.083761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:26.083761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:26.083761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:26.083761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:26.083761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:26.083761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:26.083761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:48:26.083761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:48:26.083761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:26.084345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:26.084849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:26.084849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.084849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:26.338976 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:26.338976 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:26.338976 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:26.338976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.338976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:48:26.338976 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:26.338976 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:26.338976 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:26.338976 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:26.338976 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:26.338976 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.338976 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:26.339669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.339669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:26.339669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:26.339669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:26.339669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:26.339669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:26.339669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:26.339669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:26.339669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:26.339669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:26.339669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:26.339669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:26.339669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:26.339669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:26.339669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:26.340273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:26.340273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:26.340273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:26.340273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:26.340273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:26.340273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:26.340273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:26.340273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.340273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:26.340273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.340273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:26.340273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:26.340273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:26.340273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:26.340273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:26.340809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:26.341506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:26.341506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:26.341506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:26.341506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:26.341506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:26.341506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:26.341506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:26.341506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:26.341506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:26.341506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:26.341506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.341506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:26.394439 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:26.402829 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:26.402829 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:26.402829 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:26.402829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.402829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:26.402829 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:26.402829 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:26.402829 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:26.402829 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:26.402829 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:26.402829 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.402829 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:26.403647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.403647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:26.403647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:26.403647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:26.403647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:26.403647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:26.403647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:26.403647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:26.403647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:26.403647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:26.403647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:26.403647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:26.403647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:26.403647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:48:26.403647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:26.403647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:26.403647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:26.404623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:30.956050 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:30.956862 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:30.995668 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:30.995846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:30.996547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:48:30.996547 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:30.996547 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:30.996547 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:30.996547 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:30.996547 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:30.996547 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:30.996547 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:30.997490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:30.997490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:30.997490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:30.997490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:30.997490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:30.997490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:30.997490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:30.997490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:30.997490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:30.997490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:30.997490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:30.997490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:30.997490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:30.997490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:48:30.997490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:30.997490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:30.997490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:30.998364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:31.001183 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:31.001793 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:31.001897 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:31.002043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.002466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:48:31.002466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:31.002466 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:31.002466 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:31.002466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:31.002466 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:31.002466 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.002466 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:31.003705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.003705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:31.003705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:31.003705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:31.003705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:31.003705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:31.003705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:31.003705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:31.003705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:31.003705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:31.003705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:31.003705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:31.003705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:31.003705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:48:31.003705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:31.003705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.004868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:31.079354 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:31.079848 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:48:31.080653 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:31.081147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.081944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:31.081944 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:31.081944 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:31.081944 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:31.081944 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:31.081944 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:31.081944 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.081944 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:31.082804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.082804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:31.082804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:31.082804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:31.082804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:31.082804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:31.082804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:31.082804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:31.082804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:31.082804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:31.082804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:31.082804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:31.082804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:31.082804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:31.082804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:31.082804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:31.083548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:31.083548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:31.083548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:31.083548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:31.083548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:31.083548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:31.083548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.083548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:31.084076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.084076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:31.084076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:31.084076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:31.084076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:31.084076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:31.084076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:31.084076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:31.084076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:31.084076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:31.084076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:31.084076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:31.084076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:31.084076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:48:31.084076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:48:31.084076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:31.085201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:31.086186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:31.086186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.086186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:31.334505 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:31.334766 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:31.336014 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:31.336713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.338085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:48:31.338085 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:31.338085 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:31.338085 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:31.338085 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:31.338085 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:31.338085 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.338085 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:31.339464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.339464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:31.339464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:31.339464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:31.339464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:31.339464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:31.339464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:31.339464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:31.339464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:31.339464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:31.339464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:31.339464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:31.339464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:31.339464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:31.339464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:31.339894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:31.339894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:31.339894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:31.339894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:31.339894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:31.339894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:31.339894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:31.339894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.339894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:31.343395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.343395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:31.343395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:31.343395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:31.343395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:31.343395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:31.343395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:31.343395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:31.343395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:31.343395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:31.343395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:31.343395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:31.343395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:31.343395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:48:31.343395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:48:31.343395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:31.343834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:31.344379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.344379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:31.395523 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:31.396199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:31.396937 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:31.397380 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:31.397643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.398779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:31.398779 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:31.398779 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:31.398779 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:31.398779 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:31.398779 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:31.398779 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.398779 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:31.400793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.400793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:31.400793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:31.400793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:31.400793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:31.400793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:31.400793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:31.400793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:31.400793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:31.400793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:31.400793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:31.400793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:31.400793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:31.400793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:48:31.400793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:31.400793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:31.400793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:31.401449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:35.956146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:35.957466 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:35.993671 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:35.994006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:35.994848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:48:35.994848 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:35.994848 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:35.994848 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:35.994848 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:35.994848 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:35.994848 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:35.994848 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:35.996062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:35.996062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:35.996062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:35.996062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:35.996062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:35.996062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:35.996062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:35.996062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:35.996062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:35.996062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:35.996062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:35.996062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:35.996062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:35.996062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:48:35.996062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:35.996062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:35.996062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:35.996572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:36.001658 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:36.002233 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:36.002398 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:36.002547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.003074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:48:36.003074 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:36.003074 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:36.003074 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:36.003074 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:36.003074 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:36.003074 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.003074 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:36.005086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.005086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:36.005086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:36.005086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:36.005086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:36.005086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:36.005086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:36.005086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:36.005086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:36.005086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:36.005086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:36.005086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:36.005086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:36.005086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:48:36.005086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:36.005086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.006275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:36.080115 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:36.080549 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:48:36.081095 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:36.081517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.082650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:36.082650 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:36.082650 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:36.082650 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:36.082650 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:36.082650 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:36.082650 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.082650 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:36.084488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.084488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:36.084488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:36.084488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:36.084488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:36.084488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:36.084488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:36.084488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:36.084488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:36.084488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:36.084488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:36.084488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:36.084488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:36.084488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:36.084488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:36.084488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:36.085080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:36.085080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:36.085080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:36.085080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:36.085080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:36.085080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:36.085080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.085080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:36.086282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.086282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:36.086282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:36.086282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:36.086282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:36.086282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:36.086282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:36.086282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:36.086282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:36.086282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:36.086282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:36.086282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:36.086282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:36.086282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:48:36.086282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:48:36.086282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:36.086829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:36.087593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:36.087593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.087593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:36.334936 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:36.335828 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:36.336284 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:36.336480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.337098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:48:36.337098 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:36.337098 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:36.337098 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:36.337098 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:36.337098 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:36.337098 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.337098 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:36.338828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.338828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:36.338828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:36.338828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:36.338828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:36.338828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:36.338828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:36.338828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:36.338828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:36.338828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:36.338828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:36.338828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:36.338828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:36.338828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:36.338828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:36.339703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:36.339703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:36.339703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:36.339703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:36.339703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:36.339703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:36.339703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:36.339703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.339703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:36.340855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.340855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:36.340855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:36.340855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:36.340855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:36.340855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:36.340855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:36.340855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:36.340855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:36.340855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:36.340855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:36.340855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:36.340855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:36.340855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:48:36.340855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:48:36.340855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:36.341829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:36.342776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.342776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:36.396366 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:36.396935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:36.397545 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:36.397867 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:36.398042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.398924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:36.398924 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:36.398924 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:36.398924 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:36.398924 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:36.398924 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:36.398924 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.398924 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:36.400021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.400021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:36.400021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:36.400021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:36.400021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:36.400021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:36.400021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:36.400021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:36.400021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:36.400021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:36.400021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:36.400021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:36.400021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:36.400021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:48:36.400021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:36.400021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:36.400021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:36.400832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:40.957130 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:40.972495 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:40.993937 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:40.994465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:40.995485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:48:40.995485 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:40.995485 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:40.995485 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:40.995485 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:40.995485 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:40.995485 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:40.995485 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:40.996415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:40.996415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:40.996415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:40.996415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:40.996415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:40.996415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:40.996415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:40.996415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:40.996415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:40.996415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:40.996415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:40.996415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:40.996415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:40.996415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:48:40.996415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:40.996415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:40.996415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:40.997232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:41.002006 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:41.002975 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:41.003427 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:41.003680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.004567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:48:41.004567 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:41.004567 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:41.004567 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:41.004567 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:41.004567 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:41.004567 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.004567 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:41.005725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.005725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:41.005725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:41.005725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:41.005725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:41.005725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:41.005725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:41.005725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:41.005725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:41.005725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:41.005725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:41.005725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:41.005725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:41.005725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:48:41.005725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:41.005725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.006256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:41.080887 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:41.081194 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:48:41.081963 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:41.082312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.083046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:41.083046 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:41.083046 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:41.083046 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:41.083046 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:41.083046 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:41.083046 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.083046 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:41.083839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.083839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:41.083839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:41.083839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:41.083839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:41.083839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:41.083839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:41.083839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:41.083839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:41.083839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:41.083839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:41.083839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:41.083839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:41.083839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:41.083839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:41.083839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:41.084347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:41.084347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:41.084347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:41.084347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:41.084347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:41.084347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:41.084347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.084347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:41.085298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.085298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:41.085298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:41.085298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:41.085298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:41.085298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:41.085298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:41.085298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:41.085298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:41.085298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:41.085298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:41.085298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:41.085298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:41.085298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:48:41.085298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:48:41.085298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:41.086290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:41.087528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:41.087528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.087528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:41.335583 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:41.335997 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:41.336487 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:41.336784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.337474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:48:41.337474 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:41.337474 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:41.337474 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:41.337474 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:41.337474 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:41.337474 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.337474 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:41.338748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.338748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:41.338748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:41.338748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:41.338748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:41.338748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:41.338748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:41.338748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:41.338748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:41.338748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:41.338748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:41.338748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:41.338748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:41.338748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:41.338748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:41.339228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:41.339228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:41.339228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:41.339228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:41.339228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:41.339228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:41.339228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:41.339228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.339228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:41.340671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.340671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:41.340671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:41.340671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:41.340671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:41.340671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:41.340671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:41.340671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:41.340671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:41.340671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:41.340671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:41.340671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:41.340671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:41.340671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:48:41.340671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:48:41.340671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:41.341138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:41.341621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.341621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:41.397468 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:41.398161 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:41.398813 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:41.399282 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:41.399521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.400404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:41.400404 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:41.400404 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:41.400404 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:41.400404 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:41.400404 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:41.400404 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.400404 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:41.401534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.401534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:41.401534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:41.401534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:41.401534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:41.401534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:41.401534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:41.401534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:41.401534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:41.401534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:41.401534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:41.401534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:41.401534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:41.401534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:48:41.401534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:41.401534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:41.401534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:41.402694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:45.957931 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:45.959006 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:45.993466 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:45.994230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:45.994676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:48:45.994676 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:45.994676 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:45.994676 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:45.994676 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:45.994676 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:45.994676 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:45.994676 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:45.995952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:45.995952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:45.995952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:45.995952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:45.995952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:45.995952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:45.995952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:45.995952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:45.995952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:45.995952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:45.995952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:45.995952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:45.995952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:45.995952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:48:45.995952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:45.995952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:45.995952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:45.996464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:46.002565 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:46.003627 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:46.003944 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:46.004151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.005011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:48:46.005011 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:46.005011 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:46.005011 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:46.005011 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:46.005011 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:46.005011 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.005011 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:46.006679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.006679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:46.006679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:46.006679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:46.006679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:46.006679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:46.006679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:46.006679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:46.006679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:46.006679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:46.006679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:46.006679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:46.006679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:46.006679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:48:46.006679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:46.006679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.007537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:46.081709 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:46.082436 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:48:46.083334 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:46.083628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.084511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:46.084511 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:46.084511 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:46.084511 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:46.084511 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:46.084511 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:46.084511 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.084511 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:46.085997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.085997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:46.085997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:46.085997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:46.085997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:46.085997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:46.085997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:46.085997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:46.085997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:46.085997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:46.085997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:46.085997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:46.085997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:46.085997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:46.085997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:46.085997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:46.086796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:46.086796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:46.086796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:46.086796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:46.086796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:46.086796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:46.086796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.086796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:46.088186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.088186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:46.088186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:46.088186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:46.088186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:46.088186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:46.088186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:46.088186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:46.088186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:46.088186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:46.088186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:46.088186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:46.088186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:46.088186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:48:46.088186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:48:46.088186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:46.089150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:46.089889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:46.089889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.089889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:46.336221 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:46.337101 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:46.338003 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:46.338593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.339726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:48:46.339726 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:46.339726 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:46.339726 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:46.339726 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:46.339726 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:46.339726 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.339726 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:46.340659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.340659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:46.340659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:46.340659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:46.340659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:46.340659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:46.340659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:46.340659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:46.340659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:46.340659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:46.340659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:46.340659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:46.340659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:46.340659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:46.340659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:46.341160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:46.341160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:46.341160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:46.341160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:46.341160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:46.341160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:46.341160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:46.341160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.341160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:46.341732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.341732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:46.341732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:46.341732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:46.341732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:46.341732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:46.341732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:46.341732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:46.341732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:46.341732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:46.341732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:46.341732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:46.341732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:46.341732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:48:46.341732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:48:46.341732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:46.342169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:46.342793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.342793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:46.398232 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:46.398688 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:46.399103 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:46.399405 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:46.399862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.400157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:46.400157 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:46.400157 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:46.400157 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:46.400157 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:46.400157 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:46.400157 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.400157 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:46.401153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.401153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:46.401153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:46.401153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:46.401153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:46.401153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:46.401153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:46.401153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:46.401153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:46.401153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:46.401153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:46.401153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:46.401153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:46.401153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:48:46.401153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:46.401153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:46.401153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:46.402279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:50.958640 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:50.960156 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:51.003200 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:51.004565 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:51.005006 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:51.006139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.007616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:48:51.007616 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:51.007616 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:51.007616 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:51.007616 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:51.007616 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:51.007616 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.007616 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:51.009262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.009262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:51.009262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:51.009262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:51.009262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:51.009262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:51.009262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:51.009262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:51.009262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:51.009262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:51.009262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:51.009262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:51.009262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:51.009262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:48:51.009262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:51.009262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.009847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:51.010448 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:51.010448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.010695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:48:51.010695 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:51.010695 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:51.010695 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:51.010695 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:51.010695 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:51.010695 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.010695 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:51.011954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.011954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:51.011954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:51.011954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:51.011954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:51.011954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:51.011954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:51.011954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:51.011954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:51.011954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:51.011954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:51.011954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:51.011954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:51.011954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:48:51.011954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:51.011954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:51.011954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.012532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:51.082531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:51.082953 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:48:51.083507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:51.083698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.084339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:51.084339 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:51.084339 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:51.084339 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:51.084339 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:51.084339 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:51.084339 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.084339 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:51.085613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.085613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:51.085613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:51.085613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:51.085613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:51.085613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:51.085613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:51.085613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:51.085613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:51.085613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:51.085613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:51.085613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:51.085613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:51.085613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:51.085613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:51.085613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:51.086444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:51.086444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:51.086444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:51.086444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:51.086444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:51.086444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:51.086444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.086444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:51.086844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.086844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:51.086844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:51.086844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:51.086844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:51.086844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:51.086844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:51.086844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:51.086844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:51.086844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:51.086844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:51.086844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:51.086844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:51.086844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:48:51.086844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:48:51.086844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:51.087576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:51.088352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:51.088352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.088352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:51.337319 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:51.338137 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:51.338914 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:51.339526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.340391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:48:51.340391 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:51.340391 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:51.340391 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:51.340391 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:51.340391 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:51.340391 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.340391 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:51.341816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.341816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:51.341816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:51.341816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:51.341816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:51.341816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:51.341816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:51.341816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:51.341816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:51.341816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:51.341816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:51.341816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:51.341816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:51.341816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:51.341816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:51.342656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:51.342656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:51.342656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:51.342656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:51.342656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:51.342656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:51.342656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:51.342656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.342656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:51.343701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.343701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:51.343701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:51.343701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:51.343701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:51.343701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:51.343701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:51.343701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:51.343701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:51.343701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:51.343701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:51.343701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:51.343701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:51.343701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:48:51.343701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:48:51.343701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:51.344764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:51.346023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.346023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:51.398894 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:51.399463 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:51.400234 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:51.400791 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:51.401546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.402094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:51.402094 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:51.402094 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:51.402094 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:51.402094 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:51.402094 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:51.402094 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.402094 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:51.403752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.403752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:51.403752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:51.403752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:51.403752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:51.403752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:51.403752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:51.403752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:51.403752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:51.403752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:51.403752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:51.403752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:51.403752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:51.403752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:48:51.403752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:51.403752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:51.403752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:51.404529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:55.959072 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:55.960035 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:55.993302 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:55.993751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:55.994729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:48:55.994729 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:55.994729 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:55.994729 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:55.994729 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:55.994729 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:55.994729 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:55.994729 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:55.995746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:55.995746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:55.995746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:55.995746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:55.995746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:55.995746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:55.995746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:55.995746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:55.995746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:55.995746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:55.995746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:55.995746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:55.995746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:55.995746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:48:55.995746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:55.995746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:55.995746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:55.996452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:56.003765 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:56.004763 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:56.005075 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:56.005242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.005868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:48:56.005868 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:56.005868 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:56.005868 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:56.005868 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:56.005868 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:56.005868 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.005868 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:56.007108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.007108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:56.007108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:56.007108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:56.007108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:56.007108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:56.007108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:56.007108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:56.007108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:56.007108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:56.007108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:56.007108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:56.007108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:56.007108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:48:56.007108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:56.007108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.008345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:56.083499 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:56.083834 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:48:56.084412 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:56.084734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.085552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:56.085552 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:56.085552 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:56.085552 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:56.085552 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:56.085552 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:56.085552 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.085552 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:56.086293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.086293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:56.086293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:56.086293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:56.086293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:56.086293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:56.086293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:56.086293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:56.086293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:56.086293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:56.086293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:56.086293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:56.086293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:56.086293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:56.086293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:56.086293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:56.087361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:56.087361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:56.087361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:56.087361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:56.087361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:56.087361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:56.087361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.087361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:56.087730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.087730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:56.087730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:56.087730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:56.087730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:56.087730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:56.087730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:56.087730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:56.087730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:56.087730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:56.087730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:56.087730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:56.087730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:56.087730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:48:56.087730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:48:56.087730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:56.088465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:56.089601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:56.089601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.089601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:56.337933 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:56.338459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:56.339551 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:56.340011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.341083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:48:56.341083 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:56.341083 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:56.341083 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:56.341083 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:56.341083 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:56.341083 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.341083 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:56.342459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.342459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:48:56.342459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:56.342459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:56.342459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:56.342459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:56.342459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:56.342459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:56.342459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:56.342459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:48:56.342459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:56.342459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:48:56.342459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:56.342459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:48:56.342459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:48:56.343437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:56.343437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:48:56.343437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:56.343437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:48:56.343437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:48:56.343437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:56.343437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:48:56.343437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.343437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:48:56.344032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.344032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:56.344032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:56.344032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:56.344032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:56.344032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:56.344032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:56.344032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:56.344032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:56.344032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:56.344032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:56.344032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:56.344032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:56.344032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:48:56.344032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:48:56.344032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:56.344737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:56.345532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.345532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:48:56.399481 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:48:56.400039 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:48:56.400902 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:56.401377 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:48:56.401613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.402529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:48:56.402529 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:56.402529 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:48:56.402529 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:48:56.402529 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:56.402529 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:48:56.402529 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.402529 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:48:56.404119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.404119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:48:56.404119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:48:56.404119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:48:56.404119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:48:56.404119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:48:56.404119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:56.404119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:48:56.404119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:48:56.404119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:48:56.404119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:48:56.404119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:48:56.404119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:48:56.404119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:48:56.404119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:48:56.404119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:56.404119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:48:56.405012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:00.959746 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:00.961121 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:00.998216 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:00.998552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:00.999381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:49:00.999381 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:00.999381 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:00.999381 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:00.999381 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:00.999381 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:00.999381 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:00.999381 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:01.000519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.000519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:01.000519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:01.000519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:01.000519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:01.000519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:01.000519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:01.000519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:01.000519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:01.000519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:01.000519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:01.000519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:01.000519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:01.000519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:49:01.000519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:01.000519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:01.000519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.002642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:01.004170 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:01.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:01.005219 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:01.005623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.006026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:49:01.006026 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:01.006026 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:01.006026 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:01.006026 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:01.006026 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:01.006026 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.006026 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:01.007426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.007426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:01.007426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:01.007426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:01.007426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:01.007426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:01.007426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:01.007426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:01.007426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:01.007426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:01.007426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:01.007426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:01.007426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:01.007426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:49:01.007426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:01.007426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.007957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:01.083902 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:01.084686 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:49:01.085098 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:01.085404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.086050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:01.086050 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:01.086050 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:01.086050 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:01.086050 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:01.086050 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:01.086050 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.086050 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:01.087387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.087387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:01.087387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:01.087387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:01.087387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:01.087387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:01.087387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:01.087387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:01.087387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:01.087387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:01.087387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:01.087387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:01.087387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:01.087387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:01.087387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:01.087387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:01.087895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:01.087895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:01.087895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:01.087895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:01.087895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:01.087895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:01.087895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.087895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:01.088598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.088598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:01.088598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:01.088598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:01.088598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:01.088598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:01.088598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:01.088598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:01.088598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:01.088598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:01.088598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:01.088598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:01.088598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:01.088598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:49:01.088598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:49:01.088598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:01.089035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:01.089444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:01.089444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.089444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:01.338614 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:01.339003 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:01.339697 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:01.340124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.340925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:49:01.340925 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:01.340925 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:01.340925 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:01.340925 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:01.340925 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:01.340925 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.340925 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:01.341654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.341654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:01.341654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:01.341654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:01.341654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:01.341654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:01.341654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:01.341654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:01.341654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:01.341654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:01.341654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:01.341654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:01.341654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:01.341654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:01.341654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:01.342303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:01.342303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:01.342303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:01.342303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:01.342303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:01.342303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:01.342303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:01.342303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.342303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:01.342688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.342688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:01.342688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:01.342688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:01.342688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:01.342688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:01.342688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:01.342688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:01.342688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:01.342688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:01.342688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:01.342688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:01.342688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:01.342688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:49:01.342688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:49:01.342688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:01.343559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:01.347569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.347569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:01.400369 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:01.401105 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:01.401950 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:01.402309 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:01.402461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.403156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:01.403156 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:01.403156 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:01.403156 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:01.403156 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:01.403156 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:01.403156 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.403156 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:01.404488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.404488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:01.404488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:01.404488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:01.404488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:01.404488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:01.404488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:01.404488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:01.404488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:01.404488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:01.404488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:01.404488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:01.404488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:01.404488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:49:01.404488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:01.404488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:01.404488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:01.405016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:05.960629 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:05.962337 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:05.997461 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:05.997876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:05.998618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:49:05.998618 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:05.998618 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:05.998618 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:05.998618 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:05.998618 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:05.998618 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:05.998618 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:05.999860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:05.999860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:05.999860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:05.999860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:05.999860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:05.999860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:05.999860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:05.999860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:05.999860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:05.999860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:05.999860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:05.999860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:05.999860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:05.999860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:49:05.999860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:05.999860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:05.999860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.000570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:06.004561 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:06.005576 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:06.005877 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:06.006186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.006959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:49:06.006959 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:06.006959 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:06.006959 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:06.006959 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:06.006959 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:06.006959 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.006959 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:06.008092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.008092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:06.008092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:06.008092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:06.008092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:06.008092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:06.008092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:06.008092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:06.008092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:06.008092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:06.008092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:06.008092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:06.008092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:06.008092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:49:06.008092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:06.008092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.008820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:06.084621 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:06.084897 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:49:06.085775 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:06.086144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.087205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:06.087205 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:06.087205 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:06.087205 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:06.087205 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:06.087205 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:06.087205 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.087205 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:06.088820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.088820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:06.088820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:06.088820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:06.088820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:06.088820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:06.088820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:06.088820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:06.088820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:06.088820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:06.088820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:06.088820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:06.088820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:06.088820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:06.088820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:06.088820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:06.089625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:06.089625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:06.089625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:06.089625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:06.089625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:06.089625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:06.089625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.089625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:06.090263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.090263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:06.090263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:06.090263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:06.090263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:06.090263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:06.090263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:06.090263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:06.090263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:06.090263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:06.090263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:06.090263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:06.090263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:06.090263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:49:06.090263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:49:06.090263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:06.091006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:06.091959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:06.091959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.091959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:06.339502 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:06.340006 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:06.340783 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:06.341067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.342082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:49:06.342082 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:06.342082 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:06.342082 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:06.342082 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:06.342082 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:06.342082 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.342082 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:06.342960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.342960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:06.342960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:06.342960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:06.342960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:06.342960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:06.342960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:06.342960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:06.342960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:06.342960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:06.342960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:06.342960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:06.342960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:06.342960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:06.342960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:06.343935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:06.343935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:06.343935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:06.343935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:06.343935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:06.343935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:06.343935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:06.343935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.343935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:06.344631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.344631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:06.344631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:06.344631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:06.344631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:06.344631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:06.344631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:06.344631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:06.344631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:06.344631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:06.344631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:06.344631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:06.344631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:06.344631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:49:06.344631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:49:06.344631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:06.345364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:06.345897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.345897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:06.401049 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:06.401373 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:06.402031 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:06.402380 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:06.402557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.403262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:06.403262 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:06.403262 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:06.403262 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:06.403262 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:06.403262 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:06.403262 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.403262 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:06.404381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.404381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:06.404381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:06.404381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:06.404381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:06.404381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:06.404381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:06.404381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:06.404381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:06.404381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:06.404381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:06.404381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:06.404381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:06.404381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:49:06.404381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:06.404381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:06.404381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:06.404762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:10.961129 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:10.964328 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:11.000054 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:11.000604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.001515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:49:11.001515 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:11.001515 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:11.001515 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:11.001515 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:11.001515 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:11.001515 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.001515 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:11.002370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.002370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:11.002370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:11.002370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:11.002370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:11.002370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:11.002370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:11.002370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:11.002370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:11.002370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:11.002370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:11.002370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:11.002370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:11.002370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:49:11.002370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:11.002370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:11.002370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.003248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:11.005283 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:11.006323 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:11.006500 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:11.006647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.007337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:49:11.007337 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:11.007337 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:11.007337 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:11.007337 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:11.007337 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:11.007337 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.007337 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:11.009335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.009335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:11.009335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:11.009335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:11.009335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:11.009335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:11.009335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:11.009335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:11.009335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:11.009335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:11.009335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:11.009335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:11.009335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:11.009335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:49:11.009335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:11.009335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.009801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:11.085580 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:11.086213 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:49:11.086866 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:11.087136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.088160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:11.088160 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:11.088160 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:11.088160 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:11.088160 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:11.088160 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:11.088160 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.088160 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:11.089858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.089858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:11.089858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:11.089858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:11.089858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:11.089858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:11.089858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:11.089858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:11.089858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:11.089858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:11.089858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:11.089858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:11.089858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:11.089858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:11.089858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:11.089858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:11.091674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:11.091674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:11.091674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:11.091674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:11.091674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:11.091674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:11.091674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.091674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:11.092079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.092079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:11.092079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:11.092079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:11.092079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:11.092079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:11.092079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:11.092079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:11.092079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:11.092079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:11.092079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:11.092079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:11.092079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:11.092079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:49:11.092079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:49:11.092079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:11.092547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:11.093309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:11.093309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.093309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:11.340154 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:11.340508 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:11.340940 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:11.341397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.342010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:49:11.342010 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:11.342010 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:11.342010 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:11.342010 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:11.342010 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:11.342010 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.342010 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:11.343381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.343381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:11.343381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:11.343381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:11.343381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:11.343381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:11.343381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:11.343381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:11.343381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:11.343381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:11.343381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:11.343381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:11.343381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:11.343381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:11.343381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:11.343867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:11.343867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:11.343867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:11.343867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:11.343867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:11.343867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:11.343867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:11.343867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.343867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:11.344622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.344622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:11.344622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:11.344622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:11.344622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:11.344622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:11.344622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:11.344622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:11.344622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:11.344622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:11.344622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:11.344622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:11.344622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:11.344622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:49:11.344622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:49:11.344622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:11.346172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:11.346599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.346599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:11.401620 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:11.401815 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:11.402191 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:11.402398 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:11.402498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.403043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:11.403043 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:11.403043 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:11.403043 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:11.403043 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:11.403043 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:11.403043 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.403043 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:11.403941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.403941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:11.403941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:11.403941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:11.403941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:11.403941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:11.403941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:11.403941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:11.403941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:11.403941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:11.403941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:11.403941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:11.403941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:11.403941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:49:11.403941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:11.403941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:11.403941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:11.404549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:15.961763 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:15.963580 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:16.001716 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:16.002162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.003111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:49:16.003111 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:16.003111 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:16.003111 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:16.003111 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:16.003111 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:16.003111 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.003111 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:16.004371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.004371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:16.004371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:16.004371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:16.004371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:16.004371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:16.004371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:16.004371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:16.004371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:16.004371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:16.004371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:16.004371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:16.004371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:16.004371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:49:16.004371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:16.004371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:16.004371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.005363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:16.006552 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:16.006552 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:16.006808 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:16.006922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.007704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:49:16.007704 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:16.007704 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:16.007704 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:16.007704 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:16.007704 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:16.007704 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.007704 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:16.009771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.009771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:16.009771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:16.009771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:16.009771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:16.009771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:16.009771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:16.009771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:16.009771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:16.009771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:16.009771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:16.009771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:16.009771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:16.009771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:49:16.009771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:16.009771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.010422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:16.086329 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:16.086948 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:49:16.087610 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:16.088023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.088932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:16.088932 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:16.088932 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:16.088932 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:16.088932 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:16.088932 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:16.088932 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.088932 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:16.090233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.090233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:16.090233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:16.090233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:16.090233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:16.090233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:16.090233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:16.090233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:16.090233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:16.090233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:16.090233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:16.090233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:16.090233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:16.090233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:16.090233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:16.090233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:16.091081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:16.091081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:16.091081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:16.091081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:16.091081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:16.091081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:16.091081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.091081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:16.091801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.091801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:16.091801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:16.091801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:16.091801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:16.091801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:16.091801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:16.091801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:16.091801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:16.091801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:16.091801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:16.091801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:16.091801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:16.091801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:49:16.091801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:49:16.091801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:16.092845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:16.093736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:16.093736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.093736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:16.341605 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:16.341605 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:16.342326 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:16.342679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.343553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:49:16.343553 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:16.343553 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:16.343553 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:16.343553 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:16.343553 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:16.343553 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.343553 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:16.344850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.344850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:16.344850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:16.344850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:16.344850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:16.344850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:16.344850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:16.344850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:16.344850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:16.344850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:16.344850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:16.344850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:16.344850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:16.344850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:16.344850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:16.346227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:16.346227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:16.346227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:16.346227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:16.346227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:16.346227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:16.346227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:16.346227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.346227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:16.346613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.346613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:16.346613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:16.346613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:16.346613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:16.346613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:16.346613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:16.346613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:16.346613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:16.346613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:16.346613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:16.346613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:16.346613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:16.346613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:49:16.346613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:49:16.346613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:16.350090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:16.352103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.352103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:16.402093 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:16.402631 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:16.403343 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:16.403859 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:16.403859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.404604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:16.404604 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:16.404604 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:16.404604 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:16.404604 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:16.404604 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:16.404604 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.404604 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:16.405866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.405866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:16.405866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:16.405866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:16.405866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:16.405866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:16.405866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:16.405866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:16.405866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:16.405866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:16.405866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:16.405866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:16.405866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:16.405866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:49:16.405866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:16.405866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:16.405866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:16.406427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:20.962420 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:20.963923 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:20.971549 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=241 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:49:21.006300 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:21.008802 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:21.008802 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:21.008802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.010494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:49:21.010494 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:21.010494 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:21.010494 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:21.010494 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:21.010494 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:21.010494 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.010494 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:21.013186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.013186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:21.013186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:21.013186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:21.013186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:21.013186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:21.013186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:21.013186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:21.013186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:21.013186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:21.013186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:21.013186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:21.013186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:21.013186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:49:21.013186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:21.013186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.014702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:21.015296 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:21.015296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.016559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:49:21.016559 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:21.016559 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:21.016559 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:21.016559 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:21.016559 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:21.016559 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.016559 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:21.017561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.017561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:21.017561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:21.017561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:21.017561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:21.017561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:21.017561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:21.017561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:21.017561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:21.017561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:21.017561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:21.017561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:21.017561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:21.017561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:49:21.017561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:21.017561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:21.017561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.018368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:21.087317 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:21.088048 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:49:21.088895 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:21.088895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.089418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:21.089418 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:21.089418 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:21.089418 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:21.089418 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:21.089418 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:21.089418 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.089418 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:21.090229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.090229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:21.090229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:21.090229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:21.090229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:21.090229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:21.090229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:21.090229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:21.090229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:21.090229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:21.090229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:21.090229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:21.090229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:21.090229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:21.090229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:21.090229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:21.090693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:21.090693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:21.090693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:21.090693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:21.090693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:21.090693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:21.090693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.090693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:21.091180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.091180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:21.091180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:21.091180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:21.091180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:21.091180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:21.091180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:21.091180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:21.091180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:21.091180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:21.091180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:21.091180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:21.091180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:21.091180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:49:21.091180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:49:21.091180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:21.091627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:21.091959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:21.091959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.091959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:21.341563 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:21.342611 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:21.343794 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:21.344004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.345014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:49:21.345014 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:21.345014 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:21.345014 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:21.345014 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:21.345014 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:21.345014 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.345014 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:21.346509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.346509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:21.346509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:21.346509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:21.346509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:21.346509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:21.346509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:21.346509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:21.346509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:21.346509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:21.346509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:21.346509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:21.346509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:21.346509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:21.346509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:21.347232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:21.347232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:21.347232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:21.347232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:21.347232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:21.347232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:21.347232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:21.347232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.347232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:21.348256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.348256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:21.348256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:21.348256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:21.348256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:21.348256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:21.348256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:21.348256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:21.348256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:21.348256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:21.348256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:21.348256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:21.348256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:21.348256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:49:21.348256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:49:21.348256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:21.348784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:21.349490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.349490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:21.402682 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:21.403220 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:21.404758 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:21.405148 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:21.406085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.406085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:21.406085 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:21.406085 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:21.406085 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:21.406085 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:21.406085 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:21.406085 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.406085 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:21.407251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.407251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:21.407251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:21.407251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:21.407251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:21.407251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:21.407251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:21.407251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:21.407251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:21.407251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:21.407251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:21.407251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:21.407251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:21.407251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:49:21.407251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:21.407251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:21.407251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:21.408573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:25.963345 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:25.965471 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:26.000207 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:26.000567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.001974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:49:26.001974 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:26.001974 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:26.001974 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:26.001974 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:26.001974 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:26.001974 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.001974 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:26.002333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.002333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:26.002333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:26.002333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:26.002333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:26.002333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:26.002333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:26.002333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:26.002333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:26.002333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:26.002333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:26.002333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:26.002333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:26.002333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:49:26.002333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:26.002333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:26.002333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.002998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:26.006904 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:26.007801 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:26.008035 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:26.008155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.008823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:49:26.008823 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:26.008823 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:26.008823 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:26.008823 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:26.008823 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:26.008823 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.008823 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:26.010766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.010766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:26.010766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:26.010766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:26.010766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:26.010766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:26.010766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:26.010766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:26.010766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:26.010766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:26.010766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:26.010766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:26.010766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:26.010766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:49:26.010766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:26.010766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.011296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:26.088333 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:26.088745 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:49:26.089459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:26.089676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.090459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:26.090459 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:26.090459 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:26.090459 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:26.090459 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:26.090459 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:26.090459 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.090459 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:26.091572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.091572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:26.091572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:26.091572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:26.091572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:26.091572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:26.091572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:26.091572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:26.091572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:26.091572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:26.091572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:26.091572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:26.091572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:26.091572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:26.091572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:26.091572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:26.092238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:26.092238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:26.092238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:26.092238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:26.092238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:26.092238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:26.092238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.092238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:26.092731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.092731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:26.092731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:26.092731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:26.092731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:26.092731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:26.092731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:26.092731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:26.092731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:26.092731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:26.092731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:26.092731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:26.092731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:26.092731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:49:26.092731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:49:26.092731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:26.093485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:26.094098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:26.094098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.094098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:26.342748 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:26.343106 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:26.344163 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:26.344894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.346094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:49:26.346094 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:26.346094 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:26.346094 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:26.346094 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:26.346094 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:26.346094 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.346094 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:26.347293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.347293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:26.347293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:26.347293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:26.347293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:26.347293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:26.347293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:26.347293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:26.347293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:26.347293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:26.347293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:26.347293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:26.347293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:26.347293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:26.347293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:26.348172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:26.348172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:26.348172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:26.348172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:26.348172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:26.348172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:26.348172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:26.348172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.348172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:26.348172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.348172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:26.348172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:26.348172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:26.348172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:26.348172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:26.348884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:26.349732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:26.349732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:26.349732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:26.349732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:26.349732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:26.349732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:26.349732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:26.349732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:26.349732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:26.349732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:26.349732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.349732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:26.403466 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:26.404010 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:26.404625 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:26.405107 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:26.405409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.406428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:26.406428 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:26.406428 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:26.406428 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:26.406428 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:26.406428 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:26.406428 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.406428 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:26.407961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.407961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:26.407961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:26.407961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:26.407961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:26.407961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:26.407961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:26.407961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:26.407961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:26.407961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:26.407961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:26.407961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:26.407961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:26.407961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:49:26.407961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:26.407961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:26.407961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:26.408923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:30.964818 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:30.965848 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:31.004571 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:31.004788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:31.008025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:31.009032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:31.009887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:31.009887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:31.009887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:31.009887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:31.009887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.009887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:31.009887 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:31.010525 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:31.010807 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:31.011007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.011676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:49:31.011676 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:31.011676 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:31.011676 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:31.011676 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:31.011676 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:31.011676 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.011676 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:31.012850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.012850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:31.012850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:31.012850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:31.012850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:31.012850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:31.012850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:31.012850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:31.012850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:31.012850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:31.012850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:31.012850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:31.012850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:31.012850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:49:31.012850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:31.012850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.013363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:31.088943 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:31.090655 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:49:31.092835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:31.092835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.092835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:31.092835 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:31.092835 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:31.092835 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:31.092835 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:31.092835 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:31.092835 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.092835 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:31.093243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.093243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:31.093243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:31.093243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:31.093243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:31.093243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:31.093243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:31.093243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:31.093243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:31.093243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:31.093243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:31.093243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:31.093243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:31.093243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:31.093243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:31.093243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:31.093729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:31.093729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:31.093729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:31.093729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:31.093729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:31.093729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:31.093729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.093729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:31.093970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.093970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:31.093970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:31.093970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:31.093970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:31.093970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:31.093970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:31.093970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:31.093970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:31.093970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:31.093970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:31.093970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:31.093970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:31.093970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:49:31.093970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:49:31.093970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:31.094435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:31.094902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:31.094902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.094902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:31.343120 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:31.343636 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:31.344071 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:31.344336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.344928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:49:31.344928 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:31.344928 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:31.344928 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:31.344928 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:31.344928 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:31.344928 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.344928 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:31.345842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.345842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:31.345842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:31.345842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:31.345842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:31.345842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:31.345842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:31.345842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:31.345842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:31.345842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:31.345842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:31.345842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:31.345842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:31.345842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:31.345842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:31.346562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:31.346562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:31.346562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:31.346562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:31.346562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:31.346562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:31.346562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:31.346562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.346562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:31.347070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.347070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:31.347070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:31.347070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:31.347070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:31.347070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:31.347070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:31.347070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:31.347070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:31.347070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:31.347070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:31.347070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:31.347070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:31.347070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:49:31.347070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:49:31.347070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:31.347789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:31.348601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.348601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:31.404050 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:31.404557 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:31.405199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:31.405494 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:31.405672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.406379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:31.406379 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:31.406379 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:31.406379 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:31.406379 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:31.406379 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:31.406379 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.406379 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:31.407451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.407451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:31.407451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:31.407451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:31.407451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:31.407451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:31.407451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:31.407451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:31.407451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:31.407451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:31.407451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:31.407451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:31.407451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:31.407451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:49:31.407451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:31.407451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:31.407451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:31.408010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:35.965480 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:35.967180 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:36.002011 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:36.002470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.003170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:49:36.003170 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:36.003170 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:36.003170 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:36.003170 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:36.003170 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:36.003170 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.003170 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:36.004164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.004164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:36.004164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:36.004164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:36.004164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:36.004164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:36.004164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:36.004164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:36.004164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:36.004164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:36.004164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:36.004164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:36.004164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:36.004164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:49:36.004164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:36.004164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:36.004164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.004973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:36.009581 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:36.010297 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:36.010520 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:36.010629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:36.012113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:36.012866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:36.013752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:36.013752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:36.013752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:36.013752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:36.013752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.013752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:36.090621 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:36.091076 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:49:36.091773 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:36.092059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.092675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:36.092675 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:36.092675 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:36.092675 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:36.092675 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:36.092675 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:36.092675 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.092675 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:36.093718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.093718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:36.093718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:36.093718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:36.093718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:36.093718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:36.093718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:36.093718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:36.093718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:36.093718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:36.093718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:36.093718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:36.093718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:36.093718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:36.093718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:36.093718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:36.094832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:36.094832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:36.094832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:36.094832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:36.094832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:36.094832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:36.094832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.094832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:36.095727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.095727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:36.095727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:36.095727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:36.095727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:36.095727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:36.095727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:36.095727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:36.095727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:36.095727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:36.095727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:36.095727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:36.095727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:36.095727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:49:36.095727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:49:36.095727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:36.096633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:36.097688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:36.097688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.097688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:36.343609 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:36.344181 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:36.344690 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:36.344901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.345447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:49:36.345447 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:36.345447 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:36.345447 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:36.345447 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:36.345447 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:36.345447 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.345447 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:36.346275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.346275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:36.346275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:36.346275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:36.346275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:36.346275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:36.346275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:36.346275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:36.346275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:36.346275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:36.346275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:36.346275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:36.346275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:36.346275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:36.346275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:36.346907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:36.346907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:36.346907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:36.346907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:36.346907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:36.346907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:36.346907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:36.346907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.346907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:36.347284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.347284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:36.347284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:36.347284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:36.347284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:36.347284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:36.347284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:36.347284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:36.347284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:36.347284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:36.347284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:36.347284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:36.347284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:36.347284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:49:36.347284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:49:36.347284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:36.347915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:36.348573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.348573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:36.404655 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:36.406610 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:36.407642 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:36.407903 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:36.408073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.408696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:36.408696 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:36.408696 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:36.408696 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:36.408696 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:36.408696 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:36.408696 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.408696 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:36.410071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.410071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:36.410071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:36.410071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:36.410071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:36.410071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:36.410071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:36.410071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:36.410071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:36.410071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:36.410071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:36.410071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:36.410071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:36.410071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:49:36.410071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:36.410071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:36.410071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:36.410799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:40.966130 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:40.968076 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:41.003747 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:41.004051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.004817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:49:41.004817 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:41.004817 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:41.004817 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:41.004817 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:41.004817 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:41.004817 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.004817 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:41.006078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.006078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:41.006078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:41.006078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:41.006078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:41.006078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:41.006078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:41.006078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:41.006078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:41.006078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:41.006078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:41.006078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:41.006078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:41.006078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:49:41.006078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:41.006078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:41.006078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.006637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:41.010190 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:41.013965 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:41.014159 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:41.014245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.016761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:49:41.016761 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:41.016761 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:41.016761 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:41.016761 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:41.016761 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:41.016761 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.016761 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:41.018372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.018372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:41.018372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:41.018372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:41.018372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:41.018372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:41.018372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:41.018372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:41.018372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:41.018372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:41.018372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:41.018372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:41.018372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:41.018372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:49:41.018372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:41.018372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.018872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:41.091190 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:41.092078 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:49:41.092170 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:41.092382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.093030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:41.093030 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:41.093030 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:41.093030 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:41.093030 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:41.093030 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:41.093030 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.093030 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:41.093480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.093480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:41.093480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:41.093480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:41.093480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:41.093480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:41.093480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:41.093480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:41.093480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:41.093480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:41.093480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:41.093480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:41.093480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:41.093480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:41.093480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:41.093480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:41.093938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:41.093938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:41.093938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:41.093938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:41.093938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:41.093938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:41.093938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.093938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:41.094207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.094207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:41.094207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:41.094207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:41.094207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:41.094207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:41.094207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:41.094207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:41.094207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:41.094207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:41.094207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:41.094207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:41.094207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:41.094207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:49:41.094207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:49:41.094207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:41.094614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:41.095086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:41.095086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.095086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:41.344366 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:41.344703 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:41.345603 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:41.345953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.346744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:49:41.346744 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:41.346744 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:41.346744 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:41.346744 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:41.346744 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:41.346744 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.346744 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:41.347770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.347770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:41.347770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:41.347770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:41.347770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:41.347770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:41.347770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:41.347770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:41.347770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:41.347770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:41.347770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:41.347770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:41.347770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:41.347770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:41.347770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:41.348252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:41.348252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:41.348252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:41.348252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:41.348252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:41.348252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:41.348252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:41.348252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.348252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:41.348625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.348625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:41.348625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:41.348625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:41.348625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:41.348625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:41.348625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:41.348625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:41.348625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:41.348625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:41.348625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:41.348625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:41.348625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:41.348625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:49:41.348625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:49:41.348625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:41.349030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:41.349463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.349463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:41.406735 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:41.407594 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:41.407937 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:41.408131 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:41.408131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.408575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:41.408575 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:41.408575 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:41.408575 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:41.408575 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:41.408575 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:41.408575 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.408575 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:41.409659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.409659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:41.409659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:41.409659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:41.409659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:41.409659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:41.409659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:41.409659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:41.409659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:41.409659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:41.409659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:41.409659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:41.409659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:41.409659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:49:41.409659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:41.409659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:41.409659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:41.410325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:45.967482 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:45.968587 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:46.007764 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:46.008446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.008910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:49:46.008910 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:46.008910 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:46.008910 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:46.008910 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:46.008910 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:46.008910 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.008910 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:46.010071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.010071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:46.010071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:46.010071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:46.010071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:46.010071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:46.010071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:46.010071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:46.010071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:46.010071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:46.010071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:46.010071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:46.010071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:46.010071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:49:46.010071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:46.010071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:46.010071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.010745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:46.011492 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:46.012351 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:46.012486 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:46.012567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:46.014447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:46.015029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:46.015489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:46.015489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:46.015489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:46.015489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:46.015489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.015489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:46.091912 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:46.092222 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:49:46.092528 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:46.092696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.093153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:46.093153 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:46.093153 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:46.093153 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:46.093153 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:46.093153 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:46.093153 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.093153 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:46.093913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.093913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:46.093913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:46.093913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:46.093913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:46.093913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:46.093913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:46.093913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:46.093913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:46.093913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:46.093913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:46.093913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:46.093913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:46.093913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:46.093913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:46.093913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:46.094318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:46.094318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:46.094318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:46.094318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:46.094318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:46.094318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:46.094318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.094318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:46.095178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.095178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:46.095178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:46.095178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:46.095178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:46.095178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:46.095178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:46.095178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:46.095178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:46.095178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:46.095178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:46.095178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:46.095178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:46.095178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:49:46.095178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:49:46.095178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:46.095821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:46.096496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:46.096496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.096496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:46.345064 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:46.346309 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:46.346309 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:46.346309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.350338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:46.350338 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:46.350338 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:46.350338 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:46.350338 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:46.350338 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:46.350338 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.350338 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:46.351468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.351468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:46.351468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:46.351468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:46.351468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:46.351468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:46.351468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:46.351468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:46.351468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:46.351468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:46.351468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:46.351468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:46.351468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:46.351468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:46.351468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:46.351468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:46.352223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:46.352223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:46.352223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:46.352223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:46.352223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:46.352223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:46.352223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.352223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:46.352657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.352657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:46.352657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:46.352657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:46.352657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:46.352657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:46.352657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:46.352657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:46.352657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:46.352657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:46.352657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:46.352657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:46.352657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:46.352657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:49:46.352657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:49:46.352657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:46.353442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:46.354223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.354223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:46.407646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:46.408045 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:46.408499 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:46.408646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:46.408753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.409272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:46.409272 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:46.409272 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:46.409272 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:46.409272 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:46.409272 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:46.409272 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.409272 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:46.410119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.410119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:46.410119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:46.410119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:46.410119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:46.410119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:46.410119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:46.410119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:46.410119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:46.410119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:46.410119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:46.410119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:46.410119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:46.410119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:49:46.410119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:46.410119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:46.410119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:46.411208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:50.968528 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:50.970458 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:51.006687 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:51.006886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.007693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:49:51.007693 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:51.007693 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:51.007693 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:51.007693 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:51.007693 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:51.007693 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.007693 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:51.008976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.008976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:51.008976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:51.008976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:51.008976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:51.008976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:51.008976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:51.008976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:51.008976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:51.008976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:51.008976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:51.008976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:51.008976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:51.008976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:49:51.008976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:51.008976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:51.008976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.010115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:51.012125 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:51.013361 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:51.013874 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:51.014128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.015117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:49:51.015117 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:51.015117 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:51.015117 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:51.015117 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:51.015117 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:51.015117 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.015117 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:51.017133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.017133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:51.017133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:51.017133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:51.017133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:51.017133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:51.017133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:51.017133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:51.017133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:51.017133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:51.017133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:51.017133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:51.017133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:51.017133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:49:51.017133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:51.017133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.017773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:51.092455 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:51.093574 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:49:51.095814 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:51.096078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.098386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:51.098386 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:51.098386 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:51.098386 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:51.098386 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:51.098386 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:51.098386 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.098386 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:51.099521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.099521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:51.099521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:51.099521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:51.099521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:51.099521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:51.099521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:51.099521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:51.099521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:51.099521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:51.099521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:51.099521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:51.099521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:51.099521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:51.099521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:51.099521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:51.100572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:51.100572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:51.100572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:51.100572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:51.100572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:51.100572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:51.100572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.100572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:51.101431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.101431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:51.101431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:51.101431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:51.101431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:51.101431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:51.101431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:51.101431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:51.101431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:51.101431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:51.101431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:51.101431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:51.101431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:51.101431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:49:51.101431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:49:51.101431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:51.102294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:51.103027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:51.103027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.103027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:51.346186 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:51.347035 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:51.347750 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:51.348341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.348838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:51.348838 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:51.348838 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:51.348838 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:51.348838 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:51.348838 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:51.348838 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.348838 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:51.350047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.350047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:51.350047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:51.350047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:51.350047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:51.350047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:51.350047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:51.350047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:51.350047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:51.350047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:51.350047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:51.350047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:51.350047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:51.350047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:51.350047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:51.350047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:51.350757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:51.350757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:51.350757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:51.350757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:51.350757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:51.350757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:51.350757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.350757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:51.352317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.352317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:51.352317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:51.352317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:51.352317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:51.352317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:51.352317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:51.352317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:51.352317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:51.352317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:51.352317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:51.352317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:51.352317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:51.352317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:49:51.352317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:49:51.352317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:51.353100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:51.353913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.353913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:51.408508 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:51.409242 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:51.409600 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:51.410040 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:51.410196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.410940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:51.410940 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:51.410940 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:51.410940 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:51.410940 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:51.410940 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:51.410940 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.410940 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:51.412230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.412230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:51.412230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:51.412230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:51.412230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:51.412230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:51.412230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:51.412230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:51.412230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:51.412230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:51.412230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:51.412230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:51.412230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:51.412230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:49:51.412230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:51.412230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:51.412230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:51.412922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:55.969293 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:55.970518 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:56.012717 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:56.014183 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:56.014470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.015290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:49:56.015290 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:56.015290 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:56.015290 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:56.015290 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:56.015290 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:56.015290 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.015290 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:56.016353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.016353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:56.016353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:56.016353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:56.016353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:56.016353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:56.016353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:56.016353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:56.016353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:56.016353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:56.016353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:56.016353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:56.016353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:56.016353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:49:56.016353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:56.016353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:56.016353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.016882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:56.017427 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:56.017427 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:56.017427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.017669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:49:56.017669 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:56.017669 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:56.017669 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:56.017669 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:56.017669 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:56.017669 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.017669 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:56.018944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.018944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:56.018944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:56.018944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:56.018944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:56.018944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:56.018944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:56.018944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:56.018944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:56.018944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:56.018944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:56.018944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:56.018944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:56.018944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:49:56.018944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:56.018944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.033639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:56.094065 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:56.094495 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:49:56.095098 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:56.095424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.096186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:56.096186 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:56.096186 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:56.096186 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:56.096186 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:56.096186 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:56.096186 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.096186 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:56.096952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.096952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:56.096952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:56.096952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:56.096952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:56.096952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:56.096952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:56.096952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:56.096952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:56.096952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:56.096952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:56.096952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:56.096952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:56.096952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:56.096952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:56.096952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:56.097336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:56.097336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:56.097336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:56.097336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:56.097336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:56.097336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:56.097336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.097336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:56.097708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.097708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:56.097708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:56.097708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:56.097708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:56.097708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:56.097708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:56.097708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:56.097708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:56.097708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:56.097708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:56.097708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:56.097708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:56.097708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:49:56.097708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:49:56.097708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:56.098048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:56.098833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:56.098833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.098833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:56.346821 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:56.347182 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:56.347593 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:56.347962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.349468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:56.349468 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:56.349468 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:56.349468 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:56.349468 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:56.349468 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:56.349468 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.349468 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:56.350352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.350352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:49:56.350352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:56.350352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:56.350352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:56.350352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:56.350352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:56.350352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:56.350352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:56.350352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:49:56.350352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:56.350352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:49:56.350352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:56.350352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:49:56.350352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:49:56.350352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:56.350683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:49:56.350683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:56.350683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:49:56.350683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:49:56.350683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:56.350683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:49:56.350683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.350683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:49:56.352186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.352186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:56.352186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:56.352186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:56.352186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:56.352186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:56.352186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:56.352186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:56.352186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:56.352186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:56.352186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:56.352186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:56.352186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:56.352186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:49:56.352186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:49:56.352186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:56.352717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:56.353280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.353280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:49:56.409135 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:49:56.409628 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:49:56.410248 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:56.410510 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:49:56.410651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.411158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:49:56.411158 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:56.411158 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:49:56.411158 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:49:56.411158 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:56.411158 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:49:56.411158 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.411158 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:49:56.414046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.414046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:49:56.414046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:49:56.414046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:49:56.414046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:49:56.414046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:49:56.414046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:56.414046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:49:56.414046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:49:56.414046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:49:56.414046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:49:56.414046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:49:56.414046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:49:56.414046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:49:56.414046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:49:56.414046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:56.414046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:49:56.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:00.970170 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:00.971442 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:01.014317 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:01.017954 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:01.018271 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:01.018389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.020845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:50:01.020845 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:01.020845 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:01.020845 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:01.020845 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:01.020845 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:01.020845 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.020845 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:01.023684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.023684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:01.023684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:01.023684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:01.023684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:01.023684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:01.023684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:01.023684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:01.023684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:01.023684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:01.023684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:01.023684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:01.023684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:01.023684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:50:01.023684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:01.023684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.024279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:01.024869 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:01.024869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.025504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:50:01.025504 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:01.025504 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:01.025504 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:01.025504 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:01.025504 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:01.025504 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.025504 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:01.026931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.026931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:01.026931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:01.026931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:01.026931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:01.026931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:01.026931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:01.026931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:01.026931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:01.026931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:01.026931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:01.026931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:01.026931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:01.026931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:50:01.026931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:01.026931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:01.026931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.027488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:01.094652 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:01.095411 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:50:01.096176 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:01.096507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.097272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:01.097272 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:01.097272 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:01.097272 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:01.097272 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:01.097272 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:01.097272 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.097272 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:01.098178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.098178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:01.098178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:01.098178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:01.098178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:01.098178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:01.098178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:01.098178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:01.098178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:01.098178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:01.098178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:01.098178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:01.098178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:01.098178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:01.098178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:01.098178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:01.098645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:01.098645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:01.098645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:01.098645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:01.098645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:01.098645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:01.098645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.098645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:01.099353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.099353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:01.099353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:01.099353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:01.099353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:01.099353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:01.099353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:01.099353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:01.099353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:01.099353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:01.099353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:01.099353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:01.099353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:01.099353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:50:01.099353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:50:01.099353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:01.099776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:01.100277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:01.100277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.100277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:01.347588 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:01.348657 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:01.349211 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:01.350167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.350444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:01.350444 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:01.350444 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:01.350444 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:01.350444 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:01.350444 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:01.350444 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.350444 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:01.351421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.351421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:01.351421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:01.351421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:01.351421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:01.351421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:01.351421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:01.351421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:01.351421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:01.351421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:01.351421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:01.351421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:01.351421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:01.351421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:01.351421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:01.351421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:01.352100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:01.352100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:01.352100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:01.352100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:01.352100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:01.352100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:01.352100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.352100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:01.352426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.352426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:01.352426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:01.352426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:01.352426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:01.352426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:01.352426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:01.352426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:01.352426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:01.352426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:01.352426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:01.352426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:01.352426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:01.352426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:50:01.352426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:50:01.352426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:01.353116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:01.353875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.353875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:01.409836 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:01.410634 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:01.412101 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:01.412101 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:01.412101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:01.414064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:01.414471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:01.414877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:01.414877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:01.414877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:01.414877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:05.970728 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:05.972224 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:06.008141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:06.008445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.009042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:50:06.009042 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:06.009042 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:06.009042 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:06.009042 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:06.009042 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:06.009042 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.009042 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:06.010175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.010175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:06.010175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:06.010175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:06.010175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:06.010175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:06.010175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:06.010175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:06.010175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:06.010175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:06.010175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:06.010175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:06.010175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:06.010175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:50:06.010175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:06.010175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:06.010175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.010764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:06.016374 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:06.017569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:06.017939 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:06.018238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.019409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:50:06.019409 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:06.019409 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:06.019409 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:06.019409 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:06.019409 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:06.019409 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.019409 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:06.021356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.021356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:06.021356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:06.021356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:06.021356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:06.021356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:06.021356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:06.021356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:06.021356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:06.021356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:06.021356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:06.021356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:06.021356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:06.021356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:50:06.021356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:06.021356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.021845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:06.095647 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:06.096169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:50:06.096621 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:06.096835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.097389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:06.097389 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:06.097389 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:06.097389 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:06.097389 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:06.097389 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:06.097389 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.097389 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:06.098191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.098191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:06.098191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:06.098191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:06.098191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:06.098191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:06.098191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:06.098191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:06.098191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:06.098191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:06.098191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:06.098191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:06.098191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:06.098191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:06.098191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:06.098191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:06.098676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:06.098676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:06.098676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:06.098676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:06.098676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:06.098676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:06.098676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.098676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:06.099229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.099229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:06.099229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:06.099229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:06.099229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:06.099229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:06.099229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:06.099229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:06.099229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:06.099229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:06.099229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:06.099229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:06.099229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:06.099229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:50:06.099229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:50:06.099229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:06.099783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:06.100471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:06.100471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.100471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:06.348289 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:06.348848 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:06.350082 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:06.350082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.350407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:06.350407 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:06.350407 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:06.350407 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:06.350407 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:06.350407 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:06.350407 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.350407 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:06.351437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.351437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:06.351437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:06.351437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:06.351437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:06.351437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:06.351437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:06.351437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:06.351437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:06.351437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:06.351437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:06.351437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:06.351437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:06.351437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:06.351437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:06.351437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:06.351801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:06.351801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:06.351801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:06.351801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:06.351801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:06.351801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:06.351801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.351801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:06.352581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.352581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:06.352581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:06.352581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:06.352581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:06.352581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:06.352581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:06.352581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:06.352581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:06.352581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:06.352581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:06.352581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:06.352581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:06.352581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:50:06.352581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:50:06.352581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:06.353028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:06.353369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.353369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:06.410569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:06.410945 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:06.411503 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:06.412018 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:06.412143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.412704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:06.412704 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:06.412704 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:06.412704 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:06.412704 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:06.412704 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:06.412704 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.412704 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:06.413782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.413782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:06.413782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:06.413782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:06.413782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:06.413782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:06.413782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:06.413782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:06.413782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:06.413782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:06.413782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:06.413782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:06.413782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:06.413782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:50:06.413782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:06.413782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:06.413782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:06.414542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:10.971362 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:10.972643 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:11.009371 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:11.009824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.010339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:50:11.010339 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:11.010339 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:11.010339 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:11.010339 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:11.010339 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:11.010339 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.010339 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:11.011274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.011274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:11.011274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:11.011274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:11.011274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:11.011274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:11.011274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:11.011274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:11.011274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:11.011274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:11.011274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:11.011274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:11.011274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:11.011274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:50:11.011274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:11.011274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:11.011274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.012070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:11.017098 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:11.018046 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:11.018239 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:11.018398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.019062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:50:11.019062 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:11.019062 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:11.019062 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:11.019062 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:11.019062 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:11.019062 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.019062 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:11.020267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.020267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:11.020267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:11.020267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:11.020267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:11.020267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:11.020267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:11.020267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:11.020267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:11.020267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:11.020267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:11.020267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:11.020267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:11.020267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:50:11.020267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:11.020267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.020883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:11.096314 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:11.096710 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:50:11.097423 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:11.097793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.098355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:11.098355 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:11.098355 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:11.098355 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:11.098355 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:11.098355 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:11.098355 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.098355 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:11.099043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.099043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:11.099043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:11.099043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:11.099043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:11.099043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:11.099043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:11.099043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:11.099043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:11.099043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:11.099043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:11.099043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:11.099043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:11.099043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:11.099043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:11.099043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:11.099673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:11.099673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:11.099673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:11.099673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:11.099673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:11.099673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:11.099673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.099673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:11.099911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.099911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:11.099911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:11.099911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:11.099911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:11.099911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:11.099911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:11.099911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:11.099911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:11.099911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:11.099911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:11.099911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:11.099911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:11.099911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:50:11.099911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:50:11.099911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:11.100400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:11.101046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:11.101046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.101046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:11.348945 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:11.349472 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:11.351686 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:11.351945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.352683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:11.352683 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:11.352683 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:11.352683 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:11.352683 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:11.352683 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:11.352683 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.352683 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:11.353962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.353962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:11.353962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:11.353962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:11.353962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:11.353962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:11.353962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:11.353962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:11.353962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:11.353962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:11.353962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:11.353962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:11.353962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:11.353962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:11.353962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:11.353962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:11.354789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:11.354789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:11.354789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:11.354789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:11.354789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:11.354789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:11.354789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.354789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:11.355777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.355777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:11.355777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:11.355777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:11.355777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:11.355777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:11.355777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:11.355777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:11.355777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:11.355777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:11.355777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:11.355777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:11.355777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:11.355777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:50:11.355777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:50:11.355777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:11.356534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:11.356969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.356969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:11.411649 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:11.411649 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:11.412615 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:11.412615 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:11.412856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.414044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:11.414044 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:11.414044 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:11.414044 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:11.414044 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:11.414044 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:11.414044 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.414044 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:11.415233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.415233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:11.415233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:11.415233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:11.415233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:11.415233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:11.415233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:11.415233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:11.415233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:11.415233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:11.415233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:11.415233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:11.415233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:11.415233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:50:11.415233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:11.415233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:11.415233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:11.415616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:15.795575 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:15.806271 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 07 19:50:15.806487 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=104575) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 07 19:50:15.806732 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Maintenance task: Fixing resource bfbf6c8f-1f7e-474c-a618-4e99355c0282 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:50:15.851169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, resource={'id': 'bfbf6c8f-1f7e-474c-a618-4e99355c0282', 'name': 'private', 'tenant_id': '47ea4a7c5a154b528631c5537cfdb850', 'project_id': '47ea4a7c5a154b528631c5537cfdb850', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['49f10797-7993-4eac-ad9c-5db13bcf3a17', 'bdd6f685-b77d-459b-b386-e3ef09898997'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:35:01Z', 'updated_at': '2026-04-07T19:35:05Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39614}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:15.851374 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:15.851614 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-ca0b7fb0-3499-4804-b894-4bb867203f37, external_ids_update=None, columns={'tag': 39614}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:15.851699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:15.852418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 19:50:15.852418 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:15.852418 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:15.852418 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:15.852418 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:15.852418 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:15.852418 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:15.852418 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:15.854014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Maintenance task: Failed to fix resource bfbf6c8f-1f7e-474c-a618-4e99355c0282 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:15.854014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:50:15.854014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:50:15.854014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:50:15.854014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:50:15.854014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:50:15.854014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 19:50:15.854014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:15.854014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:15.854014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:50:15.854014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:15.854458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:15.854458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:15.854458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:50:15.854458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:15.854458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:50:15.854458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:15.854458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:50:15.854458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:50:15.854458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:15.854458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:50:15.854458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:15.854458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:50:15.854458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:50:15.854458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:15.854892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:50:15.854892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:15.854892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:50:15.854892 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Maintenance task: Fixing resource 92857a9a-261a-45c8-bdf2-793e5d5977e1 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:50:15.895519 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, resource={'id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'name': 'public', 'tenant_id': '47ea4a7c5a154b528631c5537cfdb850', 'project_id': '47ea4a7c5a154b528631c5537cfdb850', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['158905cc-b5be-42da-8777-3d7ded042b7c', '6de186a3-9e7c-4950-a1c6-817a37a68984'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-07T19:35:09Z', 'updated_at': '2026-04-07T19:35:17Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:15.895776 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:15.896228 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-783e27a6-53d0-42e0-a778-7125c7a0cff1, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:15.896439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:15.897074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 19:50:15.897074 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:15.897074 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:15.897074 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:15.897074 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:15.897074 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:15.897074 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:15.897074 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:15.898202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Maintenance task: Failed to fix resource 92857a9a-261a-45c8-bdf2-793e5d5977e1 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:15.898202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:50:15.898202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:50:15.898202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:50:15.898202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:50:15.898202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:50:15.898202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 19:50:15.898202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:15.898202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:15.898202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:50:15.898202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:15.898531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:15.898531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:15.898531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:50:15.898531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:15.898531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:50:15.898531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:15.898531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:50:15.898531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:50:15.898531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:15.898531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:50:15.898531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:15.898531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:50:15.898531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:50:15.898531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:15.898873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:50:15.898873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:15.898873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:50:15.898873 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Maintenance task: Fixing resource 246975ba-4717-4c89-a181-15f0da115b38 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:50:15.930824 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-246975ba-4717-4c89-a181-15f0da115b38, resource={'id': '246975ba-4717-4c89-a181-15f0da115b38', 'name': 'admin_net', 'tenant_id': 'c55e43aaf6164fb7ba8075ffd24bc8d2', 'project_id': 'c55e43aaf6164fb7ba8075ffd24bc8d2', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['4b75275b-2834-446a-a1bf-6e510e154273'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:40:24Z', 'updated_at': '2026-04-07T19:40:25Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 64449}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:15.931073 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-246975ba-4717-4c89-a181-15f0da115b38, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:15.933923 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-f0065b7a-ceb5-4313-9c13-1796e417df18, external_ids_update=None, columns={'tag': 64449}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:15.933923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:15.933923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 19:50:15.933923 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:15.933923 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:15.933923 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:15.933923 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:15.933923 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:15.933923 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:15.933923 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:15.933923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Maintenance task: Failed to fix resource 246975ba-4717-4c89-a181-15f0da115b38 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:15.933923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:50:15.933923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:50:15.934422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:50:15.934422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:50:15.934422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:50:15.934422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 19:50:15.934422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:15.934422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:15.934422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:50:15.934422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:15.934422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:15.934422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:15.934422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:50:15.934422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:15.934422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:50:15.934789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:15.934789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:50:15.934789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:50:15.934789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:15.934789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:50:15.934789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:15.934789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:50:15.934789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:50:15.934789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:15.934789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:50:15.934789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:15.934789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:50:15.935236 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Maintenance task: Fixing resource 40ad0605-2aac-4da1-b108-03821a0aa715 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:50:15.972277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:15.975490 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:15.979599 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-40ad0605-2aac-4da1-b108-03821a0aa715, resource={'id': '40ad0605-2aac-4da1-b108-03821a0aa715', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'tenant_id': '7e48d42664ae4580840a2aef59d52e53', 'project_id': '7e48d42664ae4580840a2aef59d52e53', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['afc68917-6901-4e08-99ad-5c3d8bb8a584'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:41:05Z', 'updated_at': '2026-04-07T19:41:05Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 12961}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:15.983071 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-40ad0605-2aac-4da1-b108-03821a0aa715, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:15.983689 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-7853e8c0-165f-48a8-8e65-36b87d07f16a, external_ids_update=None, columns={'tag': 12961}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:15.983858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:15.984739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 19:50:15.984739 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:15.984739 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:15.984739 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:15.984739 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:15.984739 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:15.984739 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:15.984739 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:15.987235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Maintenance task: Failed to fix resource 40ad0605-2aac-4da1-b108-03821a0aa715 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:15.987235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:50:15.987235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:50:15.987235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:50:15.987235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:50:15.987235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:50:15.987235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 19:50:15.987235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:15.987235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:15.987235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:50:15.987235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:15.987755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:15.987755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:15.987755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:50:15.987755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:15.987755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:50:15.987755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:15.987755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:50:15.987755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:50:15.987755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:15.987755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:50:15.987755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:15.987755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:50:15.987755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:50:15.987755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:15.988111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:50:15.988111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:15.988111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:50:15.988111 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Maintenance task: Fixing resource 6e977c5e-85a0-4398-b359-5ba638de167e (type: routers) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:50:16.020545 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:16.023519 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:16.023889 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:16.027024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.033446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:50:16.033446 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:16.033446 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:16.033446 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:16.033446 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:16.033446 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:16.033446 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.033446 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:16.039575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.039575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:16.039575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:16.039575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:16.039575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:16.039575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:16.039575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:16.039575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:16.039575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:16.039575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:16.039575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:16.039575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:16.039575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:16.039575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:50:16.039575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:16.039575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.040372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:16.056285 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:16.056513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.058197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:50:16.058197 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:16.058197 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:16.058197 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:16.058197 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:16.058197 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:16.058197 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.058197 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:16.060518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.060518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:16.060518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:16.060518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:16.060518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:16.060518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:16.060518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:16.060518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:16.060518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:16.060518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:16.060518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:16.060518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:16.060518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:16.060518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:50:16.060518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:16.060518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.060518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.061345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:16.097524 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:16.098442 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:50:16.098971 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:16.099237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.100769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:16.100769 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:16.100769 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:16.100769 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:16.100769 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:16.100769 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:16.100769 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.100769 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:16.101789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.101789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:16.101789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:16.101789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:16.101789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.101789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:16.101789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:16.101789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:16.101789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.101789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:16.101789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:16.101789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:16.101789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:16.101789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:16.101789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:16.101789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:16.102375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:16.102375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:16.102375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:16.102375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:16.102375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:16.102375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:16.102375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.102375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:16.105304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.105304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:16.105304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:16.105304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:16.105304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:16.105304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:16.105304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:16.105304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:16.105304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:16.105304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:16.105304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:16.105304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:16.105304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:16.105304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:50:16.105304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:50:16.105304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:16.105855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:16.106399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:16.106399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.106399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:16.106399 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, resource={'id': '6e977c5e-85a0-4398-b359-5ba638de167e', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'project_id': '7e48d42664ae4580840a2aef59d52e53', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'external_fixed_ips': [{'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984', 'ip_address': '172.24.5.89'}, {'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c', 'ip_address': '2001:db8::d'}], 'enable_snat': True}, 'gw_port_id': '7f6e42e8-6279-4fd6-9649-d7b189f6dba8', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-a48jf', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'external_fixed_ips': [{'ip_address': '172.24.5.89', 'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984'}, {'ip_address': '2001:db8::d', 'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-07T19:41:06Z', 'updated_at': '2026-04-07T19:41:09Z', 'revision_number': 3, 'tenant_id': '7e48d42664ae4580840a2aef59d52e53'}, resource_type=routers, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:16.106609 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:16.106609 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "7f6e42e8-6279-4fd6-9649-d7b189f6dba8"')], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:16.106609 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "7f6e42e8-6279-4fd6-9649-d7b189f6dba8"')], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:16.106609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.106609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 19:50:16.106609 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:16.106609 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:16.106609 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:16.106869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:16.106869 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:16.106869 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.106869 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:16.106869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Unable to update router 6e977c5e-85a0-4398-b359-5ba638de167e. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.107703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Maintenance task: Failed to fix resource 6e977c5e-85a0-4398-b359-5ba638de167e (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.107703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:50:16.107703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:50:16.107703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:50:16.107703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:50:16.107703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:50:16.107703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 07 19:50:16.107703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 07 19:50:16.107703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 07 19:50:16.107703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 07 19:50:16.107703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 07 19:50:16.108164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 07 19:50:16.108164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 07 19:50:16.108164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:16.108164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.108164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:50:16.108164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:16.108164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:16.108164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.108164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:50:16.108164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:16.108164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:50:16.108164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:16.108164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:50:16.108164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:50:16.108562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:16.108562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:50:16.108562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:16.108562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:50:16.108562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:50:16.108562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:16.108562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:50:16.108562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.108562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:50:16.108562 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Maintenance task: Fixing resource 7f6e42e8-6279-4fd6-9649-d7b189f6dba8 (type: router_ports) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:50:16.245150 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, resource={'id': '7f6e42e8-6279-4fd6-9649-d7b189f6dba8', 'name': '', 'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'project_id': '', 'mac_address': 'fa:16:3e:18:2e:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e977c5e-85a0-4398-b359-5ba638de167e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984', 'ip_address': '172.24.5.89'}, {'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c', 'ip_address': '2001:db8::d'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000164077', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-07T19:41:06Z', 'updated_at': '2026-04-07T19:41:09Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:16.245435 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '6de186a3-9e7c-4950-a1c6-817a37a68984 158905cc-b5be-42da-8777-3d7ded042b7c', 'neutron:network_name': 'neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-6e977c5e-85a0-4398-b359-5ba638de167e'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::d/64', '172.24.5.89/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:16.245741 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=7f6e42e8-6279-4fd6-9649-d7b189f6dba8, lrouter_port=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:16.245950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.246707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 19:50:16.246707 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:16.246707 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:16.246707 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:16.246707 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:16.246707 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:16.246707 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.246707 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:16.247903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Maintenance task: Failed to fix resource 7f6e42e8-6279-4fd6-9649-d7b189f6dba8 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.247903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:50:16.247903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:50:16.247903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:50:16.247903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:50:16.247903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:50:16.247903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 07 19:50:16.247903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:16.247903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.247903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:50:16.247903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:16.248308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:16.248308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.248308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:50:16.248308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:16.248308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:50:16.248308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:16.248308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:50:16.248308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:50:16.248308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:16.248308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:50:16.248308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:16.248308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:50:16.248308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:50:16.248308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:16.248682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:50:16.248682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.248682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:50:16.248682 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Maintenance task: Synchronization completed (took 0.44 seconds)
Apr 07 19:50:16.349562 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:16.350109 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:16.350549 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:16.350917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.351613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:16.351613 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:16.351613 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:16.351613 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:16.351613 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:16.351613 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:16.351613 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.351613 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:16.352774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.352774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:16.352774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:16.352774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:16.352774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.352774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:16.352774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:16.352774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:16.352774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.352774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:16.352774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:16.352774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:16.352774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:16.352774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:16.352774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:16.352774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:16.353420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:16.353420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:16.353420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:16.353420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:16.353420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:16.353420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:16.353420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.353420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:16.354312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.354312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:16.354312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:16.354312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:16.354312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:16.354312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:16.354312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:16.354312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:16.354312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:16.354312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:16.354312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:16.354312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:16.354312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:16.354312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:50:16.354312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:50:16.354312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:16.354796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:16.355335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.355335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:16.411813 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:16.412278 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:16.412857 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:16.413145 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:16.413955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.413955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:16.413955 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:16.413955 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:16.413955 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:16.413955 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:16.413955 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:16.413955 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.413955 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:16.415150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.415150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:16.415150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:16.415150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:16.415150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:16.415150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:16.415150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:16.415150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:16.415150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:16.415150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:16.415150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:16.415150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:16.415150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:16.415150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:50:16.415150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:16.415150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.415150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:16.415951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:20.973921 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:20.975081 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:20.980729 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=434 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:50:21.021103 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:21.021345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.021999 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:21.022771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:50:21.022771 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:21.022771 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:21.022771 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:21.022771 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:21.022771 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:21.022771 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.022771 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:21.024075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.024075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:21.024075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:21.024075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:21.024075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:21.024075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:21.024075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:21.024075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:21.024075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:21.024075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:21.024075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:21.024075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:21.024075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:21.024075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:50:21.024075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:21.024075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:21.024075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.025266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:21.026104 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:21.026104 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:21.026104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.026104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:50:21.026104 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:21.026104 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:21.026104 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:21.026104 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:21.026104 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:21.026104 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.026104 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:21.026104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:21.026648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:21.027432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:21.027432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:21.027432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:21.027432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:21.027432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:21.027432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:21.027432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:21.027432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:21.027432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:21.027432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:21.027432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:21.027432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:21.027432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.027432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:21.098851 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:21.099311 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:50:21.100016 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:21.100016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.100529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:21.100529 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:21.100529 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:21.100529 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:21.100529 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:21.100529 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:21.100529 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.100529 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:21.101356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.101356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:21.101356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:21.101356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:21.101356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:21.101356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:21.101356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:21.101356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:21.101356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:21.101356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:21.101356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:21.101356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:21.101356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:21.101356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:21.101356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:21.101356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:21.101945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:21.101945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:21.101945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:21.101945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:21.101945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:21.101945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:21.101945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.101945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:21.102440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.102440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:21.102440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:21.102440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:21.102440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:21.102440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:21.102440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:21.102440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:21.102440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:21.102440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:21.102440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:21.102440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:21.102440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:21.102440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:50:21.102440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:50:21.102440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:21.103158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:21.103743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:21.103743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.103743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:21.350393 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:21.350768 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:21.351086 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:21.351461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.353121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:21.353121 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:21.353121 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:21.353121 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:21.353121 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:21.353121 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:21.353121 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.353121 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:21.353798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.353798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:21.353798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:21.353798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:21.353798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:21.353798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:21.353798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:21.353798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:21.353798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:21.353798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:21.353798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:21.353798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:21.353798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:21.353798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:21.353798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:21.353798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:21.354286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:21.354286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:21.354286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:21.354286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:21.354286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:21.354286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:21.354286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.354286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:21.354751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.354751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:21.354751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:21.354751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:21.354751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:21.354751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:21.354751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:21.354751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:21.354751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:21.354751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:21.354751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:21.354751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:21.354751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:21.354751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:50:21.354751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:50:21.354751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:21.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:21.356327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.356327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:21.412415 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:21.413112 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:21.416399 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:21.416628 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:21.416811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.417439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:21.417439 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:21.417439 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:21.417439 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:21.417439 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:21.417439 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:21.417439 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.417439 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:21.418685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.418685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:21.418685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:21.418685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:21.418685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:21.418685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:21.418685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:21.418685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:21.418685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:21.418685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:21.418685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:21.418685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:21.418685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:21.418685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:50:21.418685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:21.418685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:21.418685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:21.419167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:25.974542 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:25.976183 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:26.015728 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:26.015980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.016741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:50:26.016741 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:26.016741 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:26.016741 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:26.016741 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:26.016741 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:26.016741 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.016741 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:26.018479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.018479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:26.018479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:26.018479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:26.018479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:26.018479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:26.018479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:26.018479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:26.018479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:26.018479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:26.018479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:26.018479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:26.018479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:26.018479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:50:26.018479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:26.018479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:26.018479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.019127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:26.023142 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:26.024284 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:26.024543 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:26.026839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.026839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:50:26.026839 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:26.026839 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:26.026839 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:26.026839 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:26.026839 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:26.026839 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.026839 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:26.027468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.027468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:26.027468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:26.027468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:26.027468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:26.027468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:26.027468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:26.027468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:26.027468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:26.027468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:26.027468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:26.027468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:26.027468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:26.027468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:50:26.027468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:26.027468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.027910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:26.099436 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:26.100765 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:50:26.101446 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:26.101664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.102371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:26.102371 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:26.102371 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:26.102371 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:26.102371 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:26.102371 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:26.102371 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.102371 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:26.103657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.103657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:26.103657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:26.103657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:26.103657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:26.103657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:26.103657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:26.103657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:26.103657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:26.103657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:26.103657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:26.103657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:26.103657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:26.103657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:26.103657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:26.103657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:26.104211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:26.104211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:26.104211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:26.104211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:26.104211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:26.104211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:26.104211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.104211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:26.105085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.105085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:26.105085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:26.105085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:26.105085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:26.105085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:26.105085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:26.105085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:26.105085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:26.105085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:26.105085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:26.105085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:26.105085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:26.105085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:50:26.105085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:50:26.105085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:26.105864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:26.106714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:26.106714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.106714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:26.350958 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:26.351197 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:26.351605 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:26.351948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.352725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:26.352725 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:26.352725 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:26.352725 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:26.352725 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:26.352725 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:26.352725 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.352725 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:26.353854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.353854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:26.353854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:26.353854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:26.353854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:26.353854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:26.353854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:26.353854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:26.353854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:26.353854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:26.353854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:26.353854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:26.353854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:26.353854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:26.353854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:26.353854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:26.354436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:26.354436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:26.354436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:26.354436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:26.354436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:26.354436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:26.354436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.354436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:26.354655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.354655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:26.354655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:26.354655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:26.354655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:26.354655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:26.354655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:26.354655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:26.354655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:26.354655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:26.354655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:26.354655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:26.354655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:26.354655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:50:26.354655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:50:26.354655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:26.355113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:26.355575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.355575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:26.414410 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:26.414870 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:26.415376 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:26.415708 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:26.415902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.416523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:26.416523 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:26.416523 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:26.416523 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:26.416523 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:26.416523 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:26.416523 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.416523 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:26.418197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.418197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:26.418197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:26.418197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:26.418197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:26.418197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:26.418197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:26.418197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:26.418197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:26.418197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:26.418197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:26.418197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:26.418197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:26.418197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:50:26.418197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:26.418197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:26.418197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:26.418568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:30.975771 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:30.979189 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:31.024360 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:31.026085 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:31.026268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.027437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:50:31.027437 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:31.027437 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:31.027437 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:31.027437 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:31.027437 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:31.027437 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.027437 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:31.028915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.028915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:31.028915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:31.028915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:31.028915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:31.028915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:31.028915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:31.028915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:31.028915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:31.028915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:31.028915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:31.028915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:31.028915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:31.028915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:50:31.028915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:31.028915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:31.028915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.029519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:31.030138 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:31.030138 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:31.030138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.030380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:50:31.030380 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:31.030380 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:31.030380 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:31.030380 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:31.030380 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:31.030380 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.030380 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:31.031558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.031558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:31.031558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:31.031558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:31.031558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:31.031558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:31.031558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:31.031558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:31.031558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:31.031558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:31.031558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:31.031558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:31.031558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:31.031558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:50:31.031558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:31.031558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.032077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:31.101180 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:31.101383 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:50:31.102266 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:31.102613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.104621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:31.104621 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:31.104621 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:31.104621 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:31.104621 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:31.104621 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:31.104621 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.104621 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:31.105017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.105017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:31.105017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:31.105017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:31.105017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:31.105017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:31.105017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:31.105017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:31.105017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:31.105017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:31.105017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:31.105017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:31.105017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:31.105017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:31.105017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:31.105017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:31.105670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:31.105670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:31.105670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:31.105670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:31.105670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:31.105670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:31.105670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.105670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:31.106574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.106574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:31.106574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:31.106574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:31.106574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:31.106574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:31.106574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:31.106574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:31.106574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:31.106574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:31.106574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:31.106574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:31.106574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:31.106574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:50:31.106574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:50:31.106574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:31.107261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:31.107918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:31.107918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.107918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:31.351767 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:31.352052 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:31.352617 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:31.352894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.353445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:31.353445 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:31.353445 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:31.353445 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:31.353445 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:31.353445 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:31.353445 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.353445 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:31.354315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.354315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:31.354315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:31.354315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:31.354315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:31.354315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:31.354315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:31.354315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:31.354315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:31.354315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:31.354315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:31.354315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:31.354315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:31.354315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:31.354315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:31.354315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:31.355056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:31.355056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:31.355056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:31.355056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:31.355056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:31.355056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:31.355056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.355056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:31.355383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.355383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:31.355383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:31.355383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:31.355383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:31.355383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:31.355383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:31.355383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:31.355383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:31.355383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:31.355383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:31.355383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:31.355383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:31.355383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:50:31.355383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:50:31.355383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:31.356042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:31.356772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.356772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:31.415025 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:31.415741 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:31.416579 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:31.416795 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:31.416795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.417473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:50:31.417473 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:31.417473 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:31.417473 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:31.417473 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:31.417473 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:31.417473 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.417473 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:31.418850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.418850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:31.418850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:31.418850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:31.418850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:31.418850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:31.418850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:31.418850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:31.418850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:31.418850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:31.418850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:31.418850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:31.418850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:31.418850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:50:31.418850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:31.418850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:31.418850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:31.419613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:35.979014 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:35.980716 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:36.023269 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:36.023547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.024394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:50:36.024394 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:36.024394 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:36.024394 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:36.024394 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:36.024394 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:36.024394 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.024394 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:36.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:36.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:36.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:36.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:36.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:36.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:36.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:36.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:36.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:36.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:36.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:36.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:36.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:50:36.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:36.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:36.025420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.026071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:36.027146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:36.028909 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:36.029573 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:36.030145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.031406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:50:36.031406 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:36.031406 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:36.031406 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:36.031406 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:36.031406 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:36.031406 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.031406 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:36.034525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.034525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:36.034525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:36.034525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:36.034525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:36.034525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:36.034525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:36.034525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:36.034525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:36.034525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:36.034525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:36.034525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:36.034525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:36.034525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:50:36.034525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:36.034525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.035349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:36.101763 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:36.102196 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:50:36.103023 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:36.103279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:36.104838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:36.105540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:36.105540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:36.105540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:36.105540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:36.105540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:36.105540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:36.105540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:36.105540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:36.105540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:36.105540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:36.105540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:36.105540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.105540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:36.105897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.105897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:36.105897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:36.105897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:36.105897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:36.105897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:36.105897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:36.105897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:36.105897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:36.105897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:36.105897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:36.105897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:36.105897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:36.105897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:50:36.105897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:50:36.105897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:36.106504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:36.106978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:36.106978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.106978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:36.352528 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:36.353308 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:36.354014 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:36.356070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.356862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:36.356862 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:36.356862 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:36.356862 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:36.356862 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:36.356862 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:36.356862 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.356862 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:36.358147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.358147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:36.358147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:36.358147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:36.358147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:36.358147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:36.358147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:36.358147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:36.358147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:36.358147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:36.358147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:36.358147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:36.358147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:36.358147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:36.358147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:36.358147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:36.358974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:36.358974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:36.358974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:36.358974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:36.358974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:36.358974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:36.358974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.358974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:36.360199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.360199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:36.360199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:36.360199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:36.360199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:36.360199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:36.360199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:36.360199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:36.360199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:36.360199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:36.360199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:36.360199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:36.360199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:36.360199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:50:36.360199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:50:36.360199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:36.360969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:36.361745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.361745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:36.415751 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:36.416241 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:36.416941 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:36.417623 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:36.417727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.418976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:50:36.418976 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:36.418976 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:36.418976 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:36.418976 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:36.418976 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:36.418976 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.418976 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:36.420663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.420663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:36.420663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:36.420663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:36.420663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:36.420663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:36.420663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:36.420663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:36.420663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:36.420663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:36.420663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:36.420663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:36.420663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:36.420663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:50:36.420663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:36.420663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:36.420663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:36.421230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:40.980471 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:40.981109 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:41.018944 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:41.019224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.020098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:50:41.020098 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:41.020098 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:41.020098 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:41.020098 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:41.020098 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:41.020098 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.020098 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:41.021504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.021504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:41.021504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:41.021504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:41.021504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:41.021504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:41.021504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:41.021504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:41.021504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:41.021504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:41.021504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:41.021504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:41.021504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:41.021504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:50:41.021504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:41.021504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:41.021504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.022150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:41.028243 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:41.029078 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:41.029316 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:41.029483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.030174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:50:41.030174 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:41.030174 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:41.030174 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:41.030174 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:41.030174 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:41.030174 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.030174 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:41.031116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.031116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:41.031116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:41.031116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:41.031116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:41.031116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:41.031116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:41.031116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:41.031116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:41.031116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:41.031116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:41.031116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:41.031116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:41.031116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:50:41.031116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:41.031116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.031974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:41.102316 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:41.102733 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:50:41.103402 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:41.103623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.104219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:41.104219 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:41.104219 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:41.104219 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:41.104219 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:41.104219 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:41.104219 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.104219 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:41.105190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.105190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:41.105190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:41.105190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:41.105190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:41.105190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:41.105190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:41.105190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:41.105190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:41.105190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:41.105190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:41.105190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:41.105190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:41.105190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:41.105190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:41.105190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:41.105548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:41.105548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:41.105548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:41.105548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:41.105548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:41.105548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:41.105548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.105548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:41.107276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.107276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:41.107276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:41.107276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:41.107276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:41.107276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:41.107276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:41.107276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:41.107276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:41.107276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:41.107276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:41.107276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:41.107276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:41.107276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:50:41.107276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:50:41.107276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:41.107676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:41.108142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:41.108142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.108142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:41.353447 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:41.353804 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:41.354403 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:41.354676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.355628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:41.355628 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:41.355628 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:41.355628 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:41.355628 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:41.355628 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:41.355628 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.355628 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:41.356667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.356667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:41.356667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:41.356667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:41.356667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:41.356667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:41.356667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:41.356667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:41.356667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:41.356667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:41.356667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:41.356667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:41.356667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:41.356667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:41.356667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:41.356667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:41.357548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:41.357548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:41.357548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:41.357548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:41.357548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:41.357548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:41.357548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.357548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:41.358033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.358033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:41.358033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:41.358033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:41.358033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:41.358033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:41.358033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:41.358033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:41.358033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:41.358033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:41.358033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:41.358033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:41.358033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:41.358033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:50:41.358033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:50:41.358033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:41.358410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:41.358867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.358867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:41.416454 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:41.416825 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:41.417729 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:41.417729 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:41.417884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.418604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:50:41.418604 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:41.418604 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:41.418604 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:41.418604 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:41.418604 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:41.418604 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.418604 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:41.419754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.419754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:41.419754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:41.419754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:41.419754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:41.419754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:41.419754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:41.419754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:41.419754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:41.419754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:41.419754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:41.419754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:41.419754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:41.419754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:50:41.419754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:41.419754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:41.419754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:41.420564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:45.980381 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:45.981686 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:46.018248 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:46.018512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.019180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:50:46.019180 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:46.019180 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:46.019180 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:46.019180 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:46.019180 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:46.019180 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.019180 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:46.020166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.020166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:46.020166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:46.020166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:46.020166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:46.020166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:46.020166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:46.020166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:46.020166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:46.020166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:46.020166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:46.020166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:46.020166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:46.020166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:50:46.020166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:46.020166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:46.020166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.020709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:46.028897 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:46.029816 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:46.030065 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:46.030222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.030907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:50:46.030907 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:46.030907 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:46.030907 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:46.030907 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:46.030907 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:46.030907 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.030907 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:46.032271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.032271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:46.032271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:46.032271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:46.032271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:46.032271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:46.032271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:46.032271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:46.032271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:46.032271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:46.032271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:46.032271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:46.032271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:46.032271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:50:46.032271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:46.032271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.032905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:46.102738 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:46.103220 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:50:46.103670 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:46.103822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.105053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:46.105053 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:46.105053 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:46.105053 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:46.105053 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:46.105053 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:46.105053 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.105053 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:46.105706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.105706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:46.105706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:46.105706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:46.105706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:46.105706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:46.105706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:46.105706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:46.105706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:46.105706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:46.105706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:46.105706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:46.105706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:46.105706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:46.105706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:46.105706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:46.106311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:46.106311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:46.106311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:46.106311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:46.106311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:46.106311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:46.106311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.106311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:46.107909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.107909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:46.107909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:46.107909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:46.107909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:46.107909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:46.107909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:46.107909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:46.107909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:46.107909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:46.107909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:46.107909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:46.107909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:46.107909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:50:46.107909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:50:46.107909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:46.108492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:46.109035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:46.109035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.109035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:46.353906 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:46.354767 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:46.355482 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:46.355760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:46.358771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:46.359542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:46.359542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:46.359542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:46.359542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:46.359542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:46.359542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:46.359542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:46.359542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:46.359542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:46.359542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:46.359542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:46.359542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.359542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:46.359542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.359542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:46.360043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:46.360741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:46.360741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:46.360741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:46.360741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:46.360741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:46.360741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:46.360741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:46.360741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:46.360741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:46.360741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:46.360741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:46.360741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:46.360741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:46.360741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:46.360741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.360741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:46.417349 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:46.417949 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:46.419481 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:46.419695 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:46.419772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.420377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:50:46.420377 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:46.420377 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:46.420377 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:46.420377 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:46.420377 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:46.420377 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.420377 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:46.421463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.421463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:46.421463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:46.421463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:46.421463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:46.421463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:46.421463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:46.421463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:46.421463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:46.421463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:46.421463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:46.421463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:46.421463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:46.421463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:50:46.421463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:46.421463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:46.421463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:46.422266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:50.981146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:50.982501 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:51.019625 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:51.019950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.020754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:50:51.020754 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:51.020754 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:51.020754 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:51.020754 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:51.020754 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:51.020754 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.020754 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:51.022004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.022004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:51.022004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:51.022004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:51.022004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:51.022004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:51.022004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:51.022004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:51.022004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:51.022004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:51.022004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:51.022004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:51.022004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:51.022004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:50:51.022004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:51.022004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:51.022004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.023342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:51.029462 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:51.031513 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:51.031819 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:51.032051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.032926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:50:51.032926 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:51.032926 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:51.032926 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:51.032926 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:51.032926 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:51.032926 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.032926 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:51.034218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.034218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:51.034218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:51.034218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:51.034218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:51.034218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:51.034218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:51.034218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:51.034218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:51.034218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:51.034218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:51.034218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:51.034218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:51.034218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:50:51.034218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:51.034218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.034908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:51.103449 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:51.104008 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:50:51.104526 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:51.104755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.105379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:51.105379 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:51.105379 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:51.105379 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:51.105379 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:51.105379 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:51.105379 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.105379 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:51.106720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.106720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:51.106720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:51.106720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:51.106720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:51.106720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:51.106720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:51.106720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:51.106720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:51.106720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:51.106720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:51.106720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:51.106720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:51.106720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:51.106720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:51.106720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:51.107356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:51.107356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:51.107356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:51.107356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:51.107356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:51.107356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:51.107356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.107356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:51.108637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.108637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:51.108637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:51.108637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:51.108637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:51.108637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:51.108637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:51.108637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:51.108637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:51.108637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:51.108637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:51.108637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:51.108637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:51.108637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:50:51.108637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:50:51.108637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:51.109158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:51.109693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:51.109693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.109693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:51.354819 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:51.355789 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:51.356134 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:51.356524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.357528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:51.357528 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:51.357528 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:51.357528 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:51.357528 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:51.357528 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:51.357528 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.357528 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:51.358261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.358261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:51.358261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:51.358261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:51.358261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:51.358261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:51.358261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:51.358261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:51.358261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:51.358261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:51.358261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:51.358261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:51.358261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:51.358261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:51.358261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:51.358261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:51.360653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:51.360653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:51.360653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:51.360653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:51.360653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:51.360653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:51.360653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.360653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:51.360653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.360653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:51.360653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:51.360653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:51.360653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:51.360653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:51.360653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:51.360653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:51.361376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:51.362194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:51.362194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:51.362194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:51.362194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:51.362194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:51.362194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:51.362194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:51.362194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.362194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:51.417883 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:51.418511 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:51.419333 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:51.419567 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:51.419713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.420486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:50:51.420486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:51.420486 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:51.420486 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:51.420486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:51.420486 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:51.420486 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.420486 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:51.421652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.421652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:51.421652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:51.421652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:51.421652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:51.421652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:51.421652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:51.421652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:51.421652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:51.421652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:51.421652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:51.421652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:51.421652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:51.421652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:50:51.421652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:51.421652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:51.421652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:51.422364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:55.981880 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:55.983604 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:56.022176 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:56.022463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.023133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:50:56.023133 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:56.023133 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:56.023133 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:56.023133 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:56.023133 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:56.023133 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.023133 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:56.024101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.024101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:56.024101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:56.024101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:56.024101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:56.024101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:56.024101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:56.024101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:56.024101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:56.024101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:56.024101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:56.024101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:56.024101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:56.024101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:50:56.024101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:56.024101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:56.024101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.024666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:56.030122 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:56.031326 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:56.031637 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:56.031791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.032551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:50:56.032551 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:56.032551 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:56.032551 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:56.032551 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:56.032551 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:56.032551 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.032551 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:56.033933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.033933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:56.033933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:56.033933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:56.033933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:56.033933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:56.033933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:56.033933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:56.033933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:56.033933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:56.033933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:56.033933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:56.033933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:56.033933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:50:56.033933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:56.033933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.034756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:56.104141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:56.104563 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:50:56.105302 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:56.105547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.106135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:56.106135 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:56.106135 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:56.106135 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:56.106135 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:56.106135 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:56.106135 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.106135 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:56.106703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.106703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:56.106703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:56.106703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:56.106703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:56.106703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:56.106703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:56.106703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:56.106703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:56.106703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:56.106703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:56.106703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:56.106703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:56.106703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:56.106703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:56.106703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:56.107553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:56.107553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:56.107553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:56.107553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:56.107553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:56.107553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:56.107553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.107553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:56.107553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.107553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:56.107553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:56.107553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:56.107553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:56.107553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:56.107553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:56.107553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:56.108451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:56.109304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:56.109304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:56.109304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:56.109304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:56.109304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:56.109304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:56.109304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:56.109304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:56.109304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:56.109304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.109304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:56.356081 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:56.356394 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:56.357203 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:56.357686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.358522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:50:56.358522 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:56.358522 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:56.358522 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:56.358522 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:56.358522 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:56.358522 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.358522 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:56.360107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.360107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:50:56.360107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:56.360107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:56.360107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:56.360107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:56.360107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:56.360107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:56.360107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:56.360107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:50:56.360107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:56.360107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:50:56.360107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:56.360107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:50:56.360107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:50:56.360107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:56.360621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:50:56.360621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:56.360621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:50:56.360621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:50:56.360621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:56.360621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:50:56.360621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.360621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:50:56.361700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.361700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:56.361700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:56.361700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:56.361700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:56.361700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:56.361700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:56.361700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:56.361700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:56.361700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:56.361700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:56.361700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:56.361700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:56.361700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:50:56.361700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:50:56.361700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:56.362295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:56.362948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.362948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:50:56.418482 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:50:56.419110 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:50:56.419729 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:56.420044 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:50:56.420202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.420831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:50:56.420831 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:56.420831 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:50:56.420831 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:50:56.420831 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:56.420831 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:50:56.420831 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.420831 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:50:56.422188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.422188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:50:56.422188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:50:56.422188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:50:56.422188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:50:56.422188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:50:56.422188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:56.422188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:50:56.422188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:50:56.422188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:50:56.422188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:50:56.422188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:50:56.422188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:50:56.422188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:50:56.422188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:50:56.422188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:56.422188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:50:56.422703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:00.982790 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:00.984392 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:01.028585 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:01.028585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.029302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:51:01.029302 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:01.029302 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:01.029302 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:01.029302 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:01.029302 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:01.029302 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.029302 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:01.030476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.030476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:01.030476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:01.030476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:01.030476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:01.030476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:01.030476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:01.030476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:01.030476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:01.030476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:01.030476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:01.030476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:01.030476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:01.030476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:51:01.030476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:01.030476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:01.030476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.030968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:01.031507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:01.032010 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:01.032270 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:01.032429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.035790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:51:01.035790 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:01.035790 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:01.035790 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:01.035790 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:01.035790 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:01.035790 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.035790 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:01.036816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.036816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:01.036816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:01.036816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:01.036816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:01.036816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:01.036816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:01.036816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:01.036816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:01.036816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:01.036816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:01.036816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:01.036816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:01.036816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:51:01.036816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:01.036816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.037378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:01.105589 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:01.106166 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:51:01.107298 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:01.107572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.108675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:01.108675 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:01.108675 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:01.108675 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:01.108675 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:01.108675 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:01.108675 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.108675 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:01.109487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.109487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:01.109487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:01.109487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:01.109487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:01.109487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:01.109487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:01.109487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:01.109487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:01.109487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:01.109487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:01.109487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:01.109487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:01.109487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:01.109487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:01.109487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:01.110218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:01.110218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:01.110218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:01.110218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:01.110218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:01.110218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:01.110218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.110218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:01.110642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.110642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:01.110642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:01.110642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:01.110642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:01.110642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:01.110642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:01.110642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:01.110642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:01.110642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:01.110642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:01.110642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:01.110642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:01.110642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:51:01.110642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:51:01.110642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:01.111305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:01.111976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:01.111976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.111976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:01.356808 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:01.357439 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:01.360561 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:01.360942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.361393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:01.361393 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:01.361393 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:01.361393 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:01.361393 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:01.361393 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:01.361393 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.361393 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:01.362350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.362350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:01.362350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:01.362350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:01.362350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:01.362350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:01.362350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:01.362350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:01.362350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:01.362350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:01.362350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:01.362350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:01.362350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:01.362350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:01.362350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:01.362350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:01.363207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:01.363207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:01.363207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:01.363207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:01.363207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:01.363207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:01.363207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.363207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:01.363674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.363674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:01.363674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:01.363674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:01.363674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:01.363674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:01.363674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:01.363674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:01.363674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:01.363674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:01.363674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:01.363674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:01.363674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:01.363674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:51:01.363674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:51:01.363674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:01.364222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:01.364802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.364802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:01.419812 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:01.419812 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:01.420597 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:01.421193 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:01.421391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.422197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:51:01.422197 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:01.422197 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:01.422197 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:01.422197 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:01.422197 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:01.422197 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.422197 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:01.423439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.423439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:01.423439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:01.423439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:01.423439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:01.423439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:01.423439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:01.423439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:01.423439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:01.423439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:01.423439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:01.423439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:01.423439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:01.423439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:51:01.423439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:01.423439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:01.423439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:01.424355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:05.984011 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:05.984595 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:06.018054 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:06.018487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.019441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:51:06.019441 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:06.019441 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:06.019441 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:06.019441 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:06.019441 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:06.019441 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.019441 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:06.020594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.020594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:06.020594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:06.020594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:06.020594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:06.020594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:06.020594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:06.020594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:06.020594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:06.020594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:06.020594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:06.020594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:06.020594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:06.020594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:51:06.020594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:06.020594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:06.020594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.021118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:06.031635 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:06.033063 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:06.033369 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:06.033649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.034692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:51:06.034692 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:06.034692 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:06.034692 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:06.034692 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:06.034692 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:06.034692 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.034692 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:06.035952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.035952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:06.035952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:06.035952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:06.035952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:06.035952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:06.035952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:06.035952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:06.035952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:06.035952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:06.035952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:06.035952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:06.035952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:06.035952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:51:06.035952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:06.035952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.036642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:06.106687 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:06.107106 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:51:06.107599 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:06.107899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.108705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:06.108705 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:06.108705 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:06.108705 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:06.108705 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:06.108705 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:06.108705 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.108705 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:06.110120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.110120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:06.110120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:06.110120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:06.110120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:06.110120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:06.110120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:06.110120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:06.110120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:06.110120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:06.110120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:06.110120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:06.110120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:06.110120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:06.110120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:06.110120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:06.110787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:06.110787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:06.110787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:06.110787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:06.110787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:06.110787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:06.110787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.110787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:06.110787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.110787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:06.110787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:06.110787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:06.110787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:06.110787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:06.110787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:06.110787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:06.111793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:06.112676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:06.112676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:06.112676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:06.112676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:06.112676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:06.112676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:06.112676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:06.112676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:06.112676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:06.112676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.112676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:06.357845 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:06.358138 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:06.359128 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:06.359128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.359465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:06.359465 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:06.359465 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:06.359465 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:06.359465 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:06.359465 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:06.359465 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.359465 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:06.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:06.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:06.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:06.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:06.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:06.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:06.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:06.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:06.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:06.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:06.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:06.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:06.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:06.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:06.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:06.361188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:06.361188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:06.361188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:06.361188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:06.361188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:06.361188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:06.361188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.361188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:06.361496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.361496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:06.361496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:06.361496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:06.361496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:06.361496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:06.361496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:06.361496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:06.361496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:06.361496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:06.361496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:06.361496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:06.361496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:06.361496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:51:06.361496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:51:06.361496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:06.362078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:06.362667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.362667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:06.419727 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:06.420256 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:06.421205 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:06.421583 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:06.421826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.422742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:51:06.422742 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:06.422742 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:06.422742 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:06.422742 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:06.422742 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:06.422742 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.422742 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:06.424334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.424334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:06.424334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:06.424334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:06.424334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:06.424334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:06.424334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:06.424334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:06.424334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:06.424334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:06.424334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:06.424334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:06.424334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:06.424334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:51:06.424334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:06.424334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:06.424334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:06.425368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:10.984052 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:10.985144 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:11.022526 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:11.022775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.023479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:51:11.023479 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:11.023479 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:11.023479 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:11.023479 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:11.023479 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:11.023479 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.023479 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:11.024566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.024566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:11.024566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:11.024566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:11.024566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:11.024566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:11.024566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:11.024566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:11.024566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:11.024566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:11.024566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:11.024566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:11.024566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:11.024566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:51:11.024566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:11.024566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:11.024566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.025411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:11.032257 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:11.033598 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:11.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:11.034707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.036498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:51:11.036498 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:11.036498 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:11.036498 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:11.036498 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:11.036498 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:11.036498 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.036498 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:11.037895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.037895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:11.037895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:11.037895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:11.037895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:11.037895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:11.037895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:11.037895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:11.037895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:11.037895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:11.037895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:11.037895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:11.037895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:11.037895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:51:11.037895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:11.037895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.038565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:11.107160 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:11.107713 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:51:11.108371 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:11.108596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.109292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:11.109292 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:11.109292 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:11.109292 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:11.109292 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:11.109292 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:11.109292 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.109292 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:11.110539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.110539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:11.110539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:11.110539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:11.110539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:11.110539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:11.110539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:11.110539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:11.110539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:11.110539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:11.110539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:11.110539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:11.110539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:11.110539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:11.110539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:11.110539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:11.110983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:11.110983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:11.110983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:11.110983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:11.110983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:11.110983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:11.110983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.110983 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:11.112267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.112267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:11.112267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:11.112267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:11.112267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:11.112267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:11.112267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:11.112267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:11.112267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:11.112267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:11.112267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:11.112267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:11.112267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:11.112267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:51:11.112267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:51:11.112267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:11.112743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:11.113343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:11.113343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.113343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:11.358451 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:11.358796 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:11.359449 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:11.359756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.360379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:11.360379 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:11.360379 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:11.360379 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:11.360379 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:11.360379 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:11.360379 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.360379 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:11.361332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.361332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:11.361332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:11.361332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:11.361332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:11.361332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:11.361332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:11.361332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:11.361332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:11.361332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:11.361332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:11.361332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:11.361332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:11.361332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:11.361332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:11.361332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:11.361929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:11.361929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:11.361929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:11.361929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:11.361929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:11.361929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:11.361929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.361929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:11.362644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.362644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:11.362644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:11.362644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:11.362644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:11.362644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:11.362644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:11.362644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:11.362644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:11.362644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:11.362644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:11.362644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:11.362644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:11.362644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:51:11.362644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:51:11.362644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:11.363726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:11.364556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.364556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:11.420617 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:11.421842 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:11.422837 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:11.424499 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:11.424662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.425547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:51:11.425547 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:11.425547 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:11.425547 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:11.425547 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:11.425547 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:11.425547 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.425547 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:11.427936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.427936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:11.427936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:11.427936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:11.427936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:11.427936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:11.427936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:11.427936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:11.427936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:11.427936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:11.427936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:11.427936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:11.427936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:11.427936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:51:11.427936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:11.427936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:11.427936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:11.428437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:15.985328 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:15.986288 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:16.038131 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:16.038131 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:16.038131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.038584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:51:16.038584 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:16.038584 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:16.038584 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:16.038584 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:16.038584 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:16.038584 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.038584 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:16.039769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.039769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:16.039769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:16.039769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:16.039769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:16.039769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:16.039769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:16.039769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:16.039769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:16.039769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:16.039769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:16.039769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:16.039769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:16.039769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:51:16.039769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:16.039769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:16.039769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.040302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:16.040831 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:16.040831 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:16.040913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.041526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:51:16.041526 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:16.041526 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:16.041526 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:16.041526 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:16.041526 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:16.041526 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.041526 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:16.042462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.042462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:16.042462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:16.042462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:16.042462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:16.042462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:16.042462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:16.042462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:16.042462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:16.042462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:16.042462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:16.042462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:16.042462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:16.042462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:51:16.042462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:16.042462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.042952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:16.107779 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:16.108128 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:51:16.108747 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:16.109090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.109600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:16.109600 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:16.109600 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:16.109600 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:16.109600 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:16.109600 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:16.109600 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.109600 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:16.110510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.110510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:16.110510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:16.110510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:16.110510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:16.110510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:16.110510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:16.110510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:16.110510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:16.110510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:16.110510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:16.110510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:16.110510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:16.110510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:16.110510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:16.110510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:16.111079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:16.111079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:16.111079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:16.111079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:16.111079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:16.111079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:16.111079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.111079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:16.111631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.111631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:16.111631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:16.111631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:16.111631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:16.111631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:16.111631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:16.111631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:16.111631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:16.111631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:16.111631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:16.111631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:16.111631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:16.111631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:51:16.111631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:51:16.111631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:16.112080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:16.112735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:16.112735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.112735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:16.358936 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:16.359409 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:16.360045 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:16.360344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:16.363587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:16.364308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:16.364308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:16.364308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:16.364308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:16.364308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:16.364308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:16.364308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:16.364308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:16.364308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:16.364308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:16.364308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:16.364308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.364308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:16.365428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.365428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:16.365428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:16.365428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:16.365428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:16.365428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:16.365428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:16.365428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:16.365428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:16.365428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:16.365428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:16.365428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:16.365428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:16.365428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:51:16.365428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:51:16.365428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:16.365941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:16.366671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.366671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:16.421891 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:16.422676 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:16.423432 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:16.424069 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:16.428529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.428529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:51:16.428529 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:16.428529 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:16.428529 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:16.428529 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:16.428529 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:16.428529 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.428529 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:16.428529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.428529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:16.428529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:16.428529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:16.428529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:16.428529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:16.428529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:16.428529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:16.429249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:16.429841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:16.429841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:16.429841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:16.429841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:16.429841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:16.429841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:16.429841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:20.985868 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:20.987087 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:21.002863 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=243 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:51:21.025320 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:21.025583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.026342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:51:21.026342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:21.026342 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:21.026342 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:21.026342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:21.026342 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:21.026342 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.026342 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:21.027591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.027591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:21.027591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:21.027591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:21.027591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:21.027591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:21.027591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:21.027591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:21.027591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:21.027591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:21.027591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:21.027591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:21.027591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:21.027591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:51:21.027591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:21.027591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:21.027591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.028727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:21.036765 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:21.038108 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:21.038335 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:21.038581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.039339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:51:21.039339 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:21.039339 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:21.039339 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:21.039339 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:21.039339 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:21.039339 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.039339 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:21.041006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.041006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:21.041006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:21.041006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:21.041006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:21.041006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:21.041006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:21.041006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:21.041006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:21.041006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:21.041006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:21.041006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:21.041006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:21.041006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:51:21.041006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:21.041006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.041527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:21.108302 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:21.108929 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:51:21.109681 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:21.110004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.110869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:21.110869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:21.110869 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:21.110869 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:21.110869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:21.110869 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:21.110869 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.110869 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:21.112084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.112084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:21.112084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:21.112084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:21.112084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:21.112084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:21.112084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:21.112084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:21.112084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:21.112084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:21.112084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:21.112084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:21.112084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:21.112084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:21.112084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:21.112084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:21.112650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:21.112650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:21.112650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:21.112650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:21.112650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:21.112650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:21.112650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.112650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:21.113401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.113401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:21.113401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:21.113401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:21.113401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:21.113401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:21.113401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:21.113401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:21.113401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:21.113401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:21.113401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:21.113401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:21.113401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:21.113401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:51:21.113401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:51:21.113401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:21.113897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:21.114435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:21.114435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.114435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:21.359732 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:21.360072 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:21.360976 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:21.361377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.362098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:21.362098 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:21.362098 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:21.362098 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:21.362098 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:21.362098 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:21.362098 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.362098 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:21.363185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.363185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:21.363185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:21.363185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:21.363185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:21.363185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:21.363185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:21.363185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:21.363185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:21.363185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:21.363185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:21.363185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:21.363185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:21.363185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:21.363185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:21.363185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:21.363491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:21.363491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:21.363491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:21.363491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:21.363491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:21.363491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:21.363491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.363491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:21.364611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.364611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:21.364611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:21.364611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:21.364611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:21.364611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:21.364611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:21.364611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:21.364611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:21.364611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:21.364611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:21.364611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:21.364611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:21.364611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:51:21.364611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:51:21.364611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:21.364960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:21.365297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.365297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:21.422541 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:21.422802 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:21.423517 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:21.423911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:21.424278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.425075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:51:21.425075 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:21.425075 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:21.425075 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:21.425075 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:21.425075 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:21.425075 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.425075 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:21.426262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.426262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:21.426262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:21.426262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:21.426262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:21.426262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:21.426262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:21.426262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:21.426262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:21.426262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:21.426262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:21.426262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:21.426262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:21.426262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:51:21.426262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:21.426262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:21.426262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:21.426977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:25.986520 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:25.988418 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:26.024722 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:26.024940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.025424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:51:26.025424 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:26.025424 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:26.025424 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:26.025424 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:26.025424 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:26.025424 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.025424 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:26.026567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.026567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:26.026567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:26.026567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:26.026567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:26.026567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:26.026567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:26.026567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:26.026567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:26.026567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:26.026567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:26.026567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:26.026567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:26.026567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:51:26.026567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:26.026567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:26.026567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.027497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:26.037241 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:26.038367 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:26.038641 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:26.038942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.039850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:51:26.039850 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:26.039850 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:26.039850 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:26.039850 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:26.039850 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:26.039850 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.039850 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:26.041786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.041786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:26.041786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:26.041786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:26.041786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:26.041786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:26.041786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:26.041786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:26.041786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:26.041786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:26.041786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:26.041786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:26.041786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:26.041786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:51:26.041786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:26.041786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.042370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:26.109061 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:26.109495 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:51:26.110159 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:26.110342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.111624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:26.111624 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:26.111624 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:26.111624 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:26.111624 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:26.111624 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:26.111624 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.111624 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:26.112092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.112092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:26.112092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:26.112092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:26.112092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:26.112092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:26.112092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:26.112092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:26.112092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:26.112092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:26.112092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:26.112092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:26.112092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:26.112092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:26.112092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:26.112092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:26.113531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:26.113531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:26.113531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:26.113531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:26.113531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:26.113531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:26.113531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.113531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:26.113531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.113531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:26.113531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:26.113531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:26.113531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:26.113531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:26.113531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:26.113531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:26.114066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:26.114926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:26.114926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:26.114926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:26.114926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:26.114926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:26.114926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:26.114926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:26.114926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:26.114926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:26.114926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.114926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:26.360432 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:26.360902 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:26.361807 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:26.362111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.363018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:26.363018 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:26.363018 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:26.363018 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:26.363018 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:26.363018 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:26.363018 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.363018 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:26.364408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.364408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:26.364408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:26.364408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:26.364408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:26.364408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:26.364408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:26.364408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:26.364408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:26.364408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:26.364408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:26.364408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:26.364408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:26.364408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:26.364408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:26.364408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:26.365046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:26.365046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:26.365046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:26.365046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:26.365046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:26.365046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:26.365046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.365046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:26.366438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.366438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:26.366438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:26.366438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:26.366438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:26.366438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:26.366438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:26.366438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:26.366438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:26.366438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:26.366438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:26.366438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:26.366438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:26.366438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:51:26.366438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:51:26.366438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:26.367131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:26.367814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.367814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:26.423352 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:26.423757 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:26.424359 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:26.424601 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:26.424768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.425423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:51:26.425423 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:26.425423 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:26.425423 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:26.425423 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:26.425423 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:26.425423 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.425423 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:26.427166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.427166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:26.427166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:26.427166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:26.427166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:26.427166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:26.427166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:26.427166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:26.427166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:26.427166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:26.427166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:26.427166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:26.427166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:26.427166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:51:26.427166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:26.427166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:26.427166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:26.427851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:30.987285 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:30.988878 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:31.031812 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:31.032089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.033239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:51:31.033239 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:31.033239 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:31.033239 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:31.033239 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:31.033239 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:31.033239 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.033239 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:31.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:31.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:31.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:31.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:31.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:31.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:31.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:31.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:31.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:31.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:31.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:31.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:31.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:51:31.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:31.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:31.033853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.034634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:31.037712 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:31.038643 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:31.038823 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:31.038957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.039536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:51:31.039536 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:31.039536 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:31.039536 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:31.039536 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:31.039536 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:31.039536 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.039536 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:31.041075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.041075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:31.041075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:31.041075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:31.041075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:31.041075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:31.041075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:31.041075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:31.041075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:31.041075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:31.041075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:31.041075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:31.041075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:31.041075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:51:31.041075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:31.041075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.041476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:31.150921 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:31.150921 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:51:31.150921 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:31.150921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.151531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:31.151531 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:31.151531 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:31.151531 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:31.151531 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:31.151531 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:31.151531 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.151531 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:31.152166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.152166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:31.152166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:31.152166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:31.152166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:31.152166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:31.152166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:31.152166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:31.152166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:31.152166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:31.152166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:31.152166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:31.152166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:31.152166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:31.152166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:31.152166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:31.152521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:31.152521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:31.152521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:31.152521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:31.152521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:31.152521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:31.152521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.152521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:31.152877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.152877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:31.152877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:31.152877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:31.152877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:31.152877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:31.152877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:31.152877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:31.152877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:31.152877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:31.152877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:31.152877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:31.152877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:31.152877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:51:31.152877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:51:31.152877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:31.153410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:31.153926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:31.153926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.153926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:31.361058 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:31.361494 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:31.362296 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:31.362296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.363025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:31.363025 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:31.363025 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:31.363025 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:31.363025 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:31.363025 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:31.363025 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.363025 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:31.363753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.363753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:31.363753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:31.363753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:31.363753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:31.363753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:31.363753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:31.363753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:31.363753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:31.363753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:31.363753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:31.363753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:31.363753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:31.363753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:31.363753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:31.363753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:31.364366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:31.364366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:31.364366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:31.364366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:31.364366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:31.364366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:31.364366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.364366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:31.364859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.364859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:31.364859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:31.364859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:31.364859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:31.364859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:31.364859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:31.364859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:31.364859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:31.364859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:31.364859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:31.364859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:31.364859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:31.364859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:51:31.364859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:51:31.364859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:31.365376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:31.365702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.365702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:31.424042 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:31.424350 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:31.424758 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:31.425121 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:31.425315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.426061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:51:31.426061 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:31.426061 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:31.426061 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:31.426061 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:31.426061 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:31.426061 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.426061 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:31.427090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.427090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:31.427090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:31.427090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:31.427090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:31.427090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:31.427090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:31.427090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:31.427090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:31.427090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:31.427090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:31.427090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:31.427090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:31.427090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:51:31.427090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:31.427090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:31.427090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:31.427632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:35.987764 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:35.988971 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:36.026081 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:36.026255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.026701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:51:36.026701 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:36.026701 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:36.026701 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:36.026701 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:36.026701 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:36.026701 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.026701 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:36.027718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.027718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:36.027718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:36.027718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:36.027718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:36.027718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:36.027718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:36.027718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:36.027718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:36.027718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:36.027718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:36.027718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:36.027718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:36.027718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:51:36.027718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:36.027718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:36.027718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.028121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:36.038478 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:36.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:36.039859 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:36.039859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.040528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:51:36.040528 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:36.040528 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:36.040528 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:36.040528 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:36.040528 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:36.040528 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.040528 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:36.041661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.041661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:36.041661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:36.041661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:36.041661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:36.041661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:36.041661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:36.041661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:36.041661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:36.041661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:36.041661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:36.041661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:36.041661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:36.041661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:51:36.041661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:36.041661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.042300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:36.150039 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:36.191935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4d2c9a67-f039-4057-a878-f3ca4d48758f None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:51:36.195309 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:36.195890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.196964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4d2c9a67-f039-4057-a878-f3ca4d48758f None None] Traceback (most recent call last):
Apr 07 19:51:36.196964 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:36.196964 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:36.196964 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:36.196964 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:36.196964 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:36.196964 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.196964 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:36.197739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4d2c9a67-f039-4057-a878-f3ca4d48758f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.197739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:36.197739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:36.197739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:36.197739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:36.197739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:36.197739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:36.197739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:36.197739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:36.197739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:36.197739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:36.197739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:36.197739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:36.197739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:36.197739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:36.198196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:36.198196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:36.198196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:36.198196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:36.198196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:36.198196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:36.198196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:36.198196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.198196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:36.198677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-4d2c9a67-f039-4057-a878-f3ca4d48758f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.198677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:36.198677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:36.198677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:36.198677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:36.198677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:36.198677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:36.198677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:36.198677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:36.198677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:36.198677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:36.198677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:36.198677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:36.198677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:51:36.198677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:51:36.198677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:36.199673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:36.200570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:36.200570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.200570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:36.361734 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:36.362372 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:36.363217 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:36.363526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.364301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:36.364301 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:36.364301 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:36.364301 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:36.364301 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:36.364301 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:36.364301 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.364301 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:36.365386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.365386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:36.365386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:36.365386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:36.365386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:36.365386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:36.365386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:36.365386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:36.365386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:36.365386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:36.365386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:36.365386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:36.365386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:36.365386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:36.365386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:36.365386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:36.365865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:36.365865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:36.365865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:36.365865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:36.365865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:36.365865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:36.365865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.365865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:36.367239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.367239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:36.367239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:36.367239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:36.367239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:36.367239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:36.367239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:36.367239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:36.367239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:36.367239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:36.367239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:36.367239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:36.367239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:36.367239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:51:36.367239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:51:36.367239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:36.367745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:36.368281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.368281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:36.424505 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:36.424959 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:36.425518 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:36.425801 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:36.425958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.426638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:51:36.426638 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:36.426638 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:36.426638 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:36.426638 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:36.426638 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:36.426638 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.426638 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:36.428187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.428187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:36.428187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:36.428187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:36.428187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:36.428187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:36.428187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:36.428187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:36.428187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:36.428187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:36.428187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:36.428187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:36.428187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:36.428187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:51:36.428187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:36.428187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:36.428187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:36.431013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:40.988351 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:40.989771 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:41.028277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:41.028626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.029417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:51:41.029417 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:41.029417 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:41.029417 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:41.029417 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:41.029417 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:41.029417 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.029417 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:41.030952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.030952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:41.030952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:41.030952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:41.030952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:41.030952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:41.030952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:41.030952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:41.030952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:41.030952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:41.030952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:41.030952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:41.030952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:41.030952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:51:41.030952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:41.030952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:41.030952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.031545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:41.039128 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:41.040173 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:41.040395 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:41.040572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.041348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:51:41.041348 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:41.041348 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:41.041348 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:41.041348 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:41.041348 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:41.041348 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.041348 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:41.042699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.042699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:41.042699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:41.042699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:41.042699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:41.042699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:41.042699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:41.042699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:41.042699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:41.042699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:41.042699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:41.042699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:41.042699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:41.042699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:51:41.042699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:41.042699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.043271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:41.159647 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:41.160331 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:51:41.160812 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:41.161049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.161882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:51:41.161882 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:41.161882 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:41.161882 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:41.161882 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:41.161882 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:41.161882 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.161882 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:41.163168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.163168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:41.163168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:41.163168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:41.163168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:41.163168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:41.163168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:41.163168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:41.163168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:41.163168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:41.163168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:41.163168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:41.163168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:41.163168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:41.163168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:41.163652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:41.163652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:41.163652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:41.163652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:41.163652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:41.163652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:41.163652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:41.163652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.163652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:41.165494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.165494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:41.165494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:41.165494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:41.165494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:41.165494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:41.165494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:41.165494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:41.165494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:41.165494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:41.165494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:41.165494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:41.165494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:41.165494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:51:41.165494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:51:41.165494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:41.166068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:41.166635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:41.166635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.166635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:41.362744 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:41.363412 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:41.364392 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:41.364914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.366159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:41.366159 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:41.366159 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:41.366159 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:41.366159 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:41.366159 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:41.366159 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.366159 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:41.367704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.367704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:41.367704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:41.367704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:41.367704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:41.367704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:41.367704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:41.367704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:41.367704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:41.367704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:41.367704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:41.367704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:41.367704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:41.367704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:41.367704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:41.367704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:41.368200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:41.368200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:41.368200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:41.368200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:41.368200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:41.368200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:41.368200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.368200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:41.369841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.369841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:41.369841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:41.369841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:41.369841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:41.369841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:41.369841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:41.369841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:41.369841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:41.369841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:41.369841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:41.369841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:41.369841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:41.369841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:51:41.369841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:51:41.369841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:41.370766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:41.372059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.372059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:41.425017 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:41.425490 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:41.426101 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:41.427025 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:41.427025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.427196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:51:41.427196 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:41.427196 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:41.427196 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:41.427196 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:41.427196 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:41.427196 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.427196 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:41.428332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.428332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:41.428332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:41.428332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:41.428332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:41.428332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:41.428332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:41.428332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:41.428332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:41.428332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:41.428332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:41.428332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:41.428332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:41.428332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:51:41.428332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:41.428332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:41.428332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:41.428847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:45.988900 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:45.990175 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:46.022332 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:46.022636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.023413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:51:46.023413 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:46.023413 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:46.023413 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:46.023413 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:46.023413 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:46.023413 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.023413 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:46.024490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.024490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:46.024490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:46.024490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:46.024490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:46.024490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:46.024490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:46.024490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:46.024490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:46.024490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:46.024490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:46.024490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:46.024490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:46.024490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:51:46.024490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:46.024490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:46.024490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.025096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:46.039782 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:46.043281 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:46.043693 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:46.043933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.044859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:51:46.044859 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:46.044859 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:46.044859 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:46.044859 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:46.044859 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:46.044859 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.044859 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:46.046487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.046487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:46.046487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:46.046487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:46.046487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:46.046487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:46.046487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:46.046487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:46.046487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:46.046487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:46.046487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:46.046487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:46.046487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:46.046487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:51:46.046487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:46.046487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.047375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:46.160281 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:46.160756 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:51:46.161216 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:46.161469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.162033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:51:46.162033 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:46.162033 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:46.162033 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:46.162033 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:46.162033 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:46.162033 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.162033 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:46.162627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.162627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:46.162627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:46.162627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:46.162627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:46.162627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:46.162627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:46.162627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:46.162627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:46.162627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:46.162627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:46.162627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:46.162627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:46.162627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:46.162627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:46.163165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:46.163165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:46.163165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:46.163165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:46.163165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:46.163165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:46.163165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:46.163165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.163165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:46.163653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.163653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:46.163653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:46.163653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:46.163653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:46.163653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:46.163653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:46.163653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:46.163653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:46.163653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:46.163653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:46.163653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:46.163653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:46.163653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:51:46.163653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:51:46.163653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:46.164113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:46.164553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:46.164553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.164553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:46.363473 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:46.364022 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:46.364673 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:46.365128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.365761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:46.365761 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:46.365761 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:46.365761 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:46.365761 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:46.365761 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:46.365761 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.365761 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:46.366755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.366755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:46.366755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:46.366755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:46.366755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:46.366755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:46.366755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:46.366755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:46.366755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:46.366755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:46.366755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:46.366755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:46.366755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:46.366755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:46.366755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:46.366755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:46.367272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:46.367272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:46.367272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:46.367272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:46.367272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:46.367272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:46.367272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.367272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:46.368778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.368778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:46.368778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:46.368778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:46.368778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:46.368778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:46.368778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:46.368778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:46.368778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:46.368778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:46.368778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:46.368778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:46.368778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:46.368778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:51:46.368778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:51:46.368778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:46.369315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:46.369779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.369779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:46.425655 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:46.426222 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:46.426853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:46.427647 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:46.428240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.429617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:51:46.429617 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:46.429617 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:46.429617 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:46.429617 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:46.429617 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:46.429617 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.429617 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:46.432167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.432167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:46.432167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:46.432167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:46.432167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:46.432167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:46.432167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:46.432167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:46.432167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:46.432167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:46.432167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:46.432167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:46.432167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:46.432167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:51:46.432167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:46.432167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:46.432167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:46.432954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:50.989560 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:50.990650 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:51.028169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:51.028536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.029476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:51:51.029476 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:51.029476 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:51.029476 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:51.029476 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:51.029476 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:51.029476 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.029476 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:51.030792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.030792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:51.030792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:51.030792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:51.030792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:51.030792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:51.030792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:51.030792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:51.030792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:51.030792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:51.030792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:51.030792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:51.030792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:51.030792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:51:51.030792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:51.030792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:51.030792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.031278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:51.042601 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:51.044538 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:51.044933 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:51.044933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.045759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:51:51.045759 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:51.045759 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:51.045759 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:51.045759 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:51.045759 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:51.045759 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.045759 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:51.047190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.047190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:51.047190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:51.047190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:51.047190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:51.047190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:51.047190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:51.047190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:51.047190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:51.047190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:51.047190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:51.047190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:51.047190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:51.047190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:51:51.047190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:51.047190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.047609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:51.160816 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:51.161376 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:51:51.161870 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:51.162847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.162910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:51:51.162910 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:51.162910 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:51.162910 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:51.162910 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:51.162910 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:51.162910 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.162910 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:51.163501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.163501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:51.163501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:51.163501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:51.163501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:51.163501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:51.163501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:51.163501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:51.163501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:51.163501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:51.163501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:51.163501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:51.163501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:51.163501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:51.163501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:51.164039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:51.164039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:51.164039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:51.164039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:51.164039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:51.164039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:51.164039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:51.164039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.164039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:51.164444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.164444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:51.164444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:51.164444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:51.164444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:51.164444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:51.164444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:51.164444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:51.164444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:51.164444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:51.164444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:51.164444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:51.164444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:51.164444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:51:51.164444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:51:51.164444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:51.164847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:51.165470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:51.165470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.165470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:51.364064 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:51.364458 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:51.364951 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:51.365231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.365617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:51.365617 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:51.365617 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:51.365617 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:51.365617 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:51.365617 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:51.365617 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.365617 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:51.366293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.366293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:51.366293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:51.366293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:51.366293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:51.366293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:51.366293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:51.366293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:51.366293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:51.366293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:51.366293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:51.366293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:51.366293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:51.366293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:51.366293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:51.366293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:51.366858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:51.366858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:51.366858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:51.366858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:51.366858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:51.366858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:51.366858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.366858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:51.367173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.367173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:51.367173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:51.367173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:51.367173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:51.367173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:51.367173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:51.367173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:51.367173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:51.367173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:51.367173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:51.367173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:51.367173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:51.367173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:51:51.367173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:51:51.367173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:51.368044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:51.368662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.368662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:51.426227 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:51.426713 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:51.427314 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:51.427584 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:51.427723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.428937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:51:51.428937 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:51.428937 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:51.428937 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:51.428937 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:51.428937 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:51.428937 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.428937 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:51.430042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.430042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:51.430042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:51.430042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:51.430042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:51.430042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:51.430042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:51.430042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:51.430042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:51.430042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:51.430042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:51.430042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:51.430042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:51.430042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:51:51.430042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:51.430042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:51.430042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:51.430807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:55.990248 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:55.991773 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:56.028801 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:56.029314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.030264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:51:56.030264 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:56.030264 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:56.030264 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:56.030264 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:56.030264 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:56.030264 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.030264 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:56.031399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.031399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:56.031399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:56.031399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:56.031399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:56.031399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:56.031399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:56.031399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:56.031399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:56.031399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:56.031399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:56.031399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:56.031399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:56.031399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:51:56.031399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:56.031399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:56.031399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.032208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:56.043549 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:56.044623 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:56.044924 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:56.045979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.045979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:51:56.045979 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:56.045979 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:56.045979 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:56.045979 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:56.045979 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:56.045979 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.045979 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:56.047030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.047030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:56.047030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:56.047030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:56.047030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:56.047030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:56.047030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:56.047030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:56.047030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:56.047030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:56.047030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:56.047030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:56.047030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:56.047030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:51:56.047030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:56.047030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.047814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:56.161449 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:56.162014 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:51:56.162587 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:56.162852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.163610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:51:56.163610 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:56.163610 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:56.163610 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:56.163610 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:56.163610 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:56.163610 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.163610 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:56.164832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.164832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:56.164832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:56.164832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:56.164832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:56.164832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:56.164832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:56.164832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:56.164832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:56.164832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:56.164832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:56.164832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:56.164832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:56.164832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:56.164832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:56.165460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:56.165460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:56.165460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:56.165460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:56.165460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:56.165460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:56.165460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:56.165460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.165460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:56.165784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.165784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:56.165784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:56.165784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:56.165784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:56.165784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:56.165784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:56.165784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:56.165784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:56.165784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:56.165784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:56.165784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:56.165784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:56.165784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:51:56.165784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:51:56.165784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:56.166257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:56.166767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:56.166767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.166767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:56.364579 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:56.365234 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:56.365573 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:56.365808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.366416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:51:56.366416 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:56.366416 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:56.366416 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:56.366416 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:56.366416 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:56.366416 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.366416 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:56.367205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.367205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:51:56.367205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:56.367205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:56.367205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:56.367205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:56.367205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:56.367205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:56.367205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:56.367205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:51:56.367205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:56.367205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:51:56.367205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:56.367205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:51:56.367205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:51:56.367205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:56.367676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:51:56.367676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:56.367676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:51:56.367676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:51:56.367676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:56.367676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:51:56.367676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.367676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:51:56.368034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.368034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:56.368034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:56.368034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:56.368034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:56.368034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:56.368034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:56.368034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:56.368034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:56.368034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:56.368034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:56.368034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:56.368034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:56.368034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:51:56.368034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:51:56.368034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:56.368470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:56.368951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.368951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:51:56.426826 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:51:56.427564 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:51:56.427975 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:56.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:51:56.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.429124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:51:56.429124 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:56.429124 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:51:56.429124 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:51:56.429124 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:56.429124 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:51:56.429124 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.429124 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:51:56.430844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.430844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:51:56.430844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:51:56.430844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:51:56.430844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:51:56.430844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:51:56.430844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:56.430844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:51:56.430844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:51:56.430844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:51:56.430844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:51:56.430844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:51:56.430844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:51:56.430844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:51:56.430844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:51:56.430844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:56.430844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:51:56.431514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:00.991095 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:00.992728 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:01.030355 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:01.030823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.031827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:52:01.031827 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:01.031827 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:01.031827 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:01.031827 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:01.031827 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:01.031827 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.031827 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:01.032685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.032685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:01.032685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:01.032685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:01.032685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:01.032685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:01.032685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:01.032685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:01.032685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:01.032685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:01.032685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:01.032685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:01.032685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:01.032685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:52:01.032685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:01.032685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:01.032685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.033443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:01.044116 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:01.045632 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:01.046060 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:01.046348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.047462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:52:01.047462 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:01.047462 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:01.047462 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:01.047462 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:01.047462 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:01.047462 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.047462 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:01.048912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.048912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:01.048912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:01.048912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:01.048912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:01.048912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:01.048912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:01.048912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:01.048912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:01.048912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:01.048912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:01.048912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:01.048912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:01.048912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:52:01.048912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:01.048912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.049469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:01.162036 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:01.162654 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:52:01.163125 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:01.163367 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.163948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:52:01.163948 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:01.163948 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:01.163948 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:01.163948 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:01.163948 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:01.163948 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.163948 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:01.164898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.164898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:01.164898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:01.164898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:01.164898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:01.164898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:01.164898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:01.164898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:01.164898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:01.164898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:01.164898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:01.164898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:01.164898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:01.164898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:01.164898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:01.165317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:01.165317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:01.165317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:01.165317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:01.165317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:01.165317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:01.165317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:01.165317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.165317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:01.166032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.166032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:01.166032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:01.166032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:01.166032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:01.166032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:01.166032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:01.166032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:01.166032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:01.166032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:01.166032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:01.166032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:01.166032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:01.166032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:52:01.166032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:52:01.166032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:01.166519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:01.167041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:01.167041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.167041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:01.365516 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:01.366455 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:01.367085 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:01.367969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.368685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:52:01.368685 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:01.368685 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:01.368685 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:01.368685 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:01.368685 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:01.368685 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.368685 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:01.371522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.371522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:01.371522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:01.371522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:01.371522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:01.371522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:01.371522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:01.371522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:01.371522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:01.371522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:01.371522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:01.371522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:01.371522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:01.371522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:01.371522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:01.371522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:01.372288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:01.372288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:01.372288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:01.372288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:01.372288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:01.372288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:01.372288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.372288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:01.372949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.372949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:01.372949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:01.372949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:01.372949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:01.372949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:01.372949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:01.372949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:01.372949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:01.372949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:01.372949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:01.372949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:01.372949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:01.372949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:52:01.372949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:52:01.372949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:01.373525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:01.374044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.374044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:01.427536 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:01.427966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:01.428830 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:01.429146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:01.429292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.429955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:52:01.429955 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:01.429955 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:01.429955 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:01.429955 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:01.429955 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:01.429955 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.429955 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:01.431427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.431427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:01.431427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:01.431427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:01.431427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:01.431427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:01.431427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:01.431427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:01.431427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:01.431427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:01.431427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:01.431427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:01.431427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:01.431427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:52:01.431427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:01.431427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:01.431427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:01.432893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:05.991684 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:05.993278 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:06.032205 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:06.032463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.032841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:52:06.032841 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:06.032841 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:06.032841 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:06.032841 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:06.032841 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:06.032841 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.032841 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:06.034227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.034227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:06.034227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:06.034227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:06.034227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:06.034227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:06.034227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:06.034227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:06.034227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:06.034227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:06.034227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:06.034227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:06.034227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:06.034227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:52:06.034227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:06.034227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:06.034227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.035060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:06.044926 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:06.046153 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:06.046519 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:06.046808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.047907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:52:06.047907 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:06.047907 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:06.047907 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:06.047907 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:06.047907 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:06.047907 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.047907 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:52:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:06.049650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.050832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:06.162758 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:06.163495 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:52:06.164151 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:06.164374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.165119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:52:06.165119 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:06.165119 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:06.165119 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:06.165119 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:06.165119 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:06.165119 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.165119 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:06.166530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.166530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:06.166530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:06.166530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:06.166530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:06.166530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:06.166530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:06.166530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:06.166530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:06.166530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:06.166530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:06.166530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:06.166530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:06.166530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:06.166530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:06.167112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:06.167112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:06.167112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:06.167112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:06.167112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:06.167112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:06.167112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:06.167112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.167112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:06.168335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.168335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:06.168335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:06.168335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:06.168335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:06.168335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:06.168335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:06.168335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:06.168335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:06.168335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:06.168335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:06.168335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:06.168335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:06.168335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:52:06.168335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:52:06.168335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:06.168886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:06.169498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:06.169498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.169498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:06.366122 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:06.366545 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:06.366832 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:06.367079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.367531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:52:06.367531 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:06.367531 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:06.367531 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:06.367531 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:06.367531 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:06.367531 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.367531 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:06.368144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.368144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:06.368144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:06.368144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:06.368144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:06.368144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:06.368144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:06.368144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:06.368144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:06.368144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:06.368144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:06.368144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:06.368144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:06.368144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:06.368144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:06.368144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:06.368796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:06.368796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:06.368796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:06.368796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:06.368796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:06.368796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:06.368796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.368796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:06.369201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.369201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:06.369201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:06.369201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:06.369201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:06.369201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:06.369201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:06.369201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:06.369201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:06.369201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:06.369201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:06.369201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:06.369201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:06.369201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:52:06.369201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:52:06.369201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:06.369819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:06.370463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.370463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:06.428023 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:06.428709 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:06.429406 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:06.429884 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:06.430247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.431287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:52:06.431287 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:06.431287 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:06.431287 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:06.431287 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:06.431287 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:06.431287 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.431287 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:06.432353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.432353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:06.432353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:06.432353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:06.432353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:06.432353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:06.432353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:06.432353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:06.432353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:06.432353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:06.432353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:06.432353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:06.432353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:06.432353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:52:06.432353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:06.432353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:06.432353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:06.433170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:10.992314 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:10.994042 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:11.029439 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:11.029692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.030396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:52:11.030396 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:11.030396 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:11.030396 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:11.030396 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:11.030396 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:11.030396 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.030396 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:11.031516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.031516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:11.031516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:11.031516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:11.031516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:11.031516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:11.031516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:11.031516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:11.031516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:11.031516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:11.031516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:11.031516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:11.031516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:11.031516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:52:11.031516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:11.031516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:11.031516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.032542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:11.045575 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:11.047106 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:11.047422 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:11.047649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.048494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:52:11.048494 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:11.048494 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:11.048494 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:11.048494 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:11.048494 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:11.048494 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.048494 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:11.049811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.049811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:11.049811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:11.049811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:11.049811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:11.049811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:11.049811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:11.049811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:11.049811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:11.049811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:11.049811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:11.049811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:11.049811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:11.049811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:52:11.049811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:11.049811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.050202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:11.163565 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:11.164250 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:52:11.165155 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:11.165492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.166692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:52:11.166692 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:11.166692 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:11.166692 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:11.166692 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:11.166692 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:11.166692 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.166692 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:11.168241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.168241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:11.168241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:11.168241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:11.168241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:11.168241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:11.168241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:11.168241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:11.168241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:11.168241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:11.168241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:11.168241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:11.168241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:11.168241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:11.168241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:11.168750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:11.168750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:11.168750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:11.168750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:11.168750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:11.168750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:11.168750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:11.168750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.168750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:11.170240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.170240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:11.170240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:11.170240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:11.170240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:11.170240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:11.170240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:11.170240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:11.170240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:11.170240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:11.170240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:11.170240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:11.170240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:11.170240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:52:11.170240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:52:11.170240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:11.170709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:11.171240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:11.171240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.171240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:11.389560 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:11.389560 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:11.389560 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:11.389560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.389560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:52:11.389560 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:11.389560 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:11.389560 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:11.389560 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:11.389560 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:11.389560 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.389560 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:11.389943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.389943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:11.389943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:11.389943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:11.389943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:11.389943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:11.389943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:11.389943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:11.389943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:11.389943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:11.389943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:11.389943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:11.389943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:11.389943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:11.389943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:11.389943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:11.390707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:11.390707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:11.390707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:11.390707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:11.390707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:11.390707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:11.390707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.390707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:11.390707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.390707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:11.390707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:11.390707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:11.390707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:11.390707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:11.390707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:11.390707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:11.391355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:11.391899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:11.391899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:11.391899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:11.391899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:11.391899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:11.391899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:11.391899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:11.391899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.391899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:11.428646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:11.429333 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:11.429758 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:11.430124 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:11.430330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.431052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:52:11.431052 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:11.431052 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:11.431052 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:11.431052 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:11.431052 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:11.431052 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.431052 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:11.432112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.432112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:11.432112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:11.432112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:11.432112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:11.432112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:11.432112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:11.432112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:11.432112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:11.432112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:11.432112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:11.432112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:11.432112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:11.432112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:52:11.432112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:11.432112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:11.432112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:11.432568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:15.993013 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:15.994450 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:16.032148 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:16.033216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.033674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:52:16.033674 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:16.033674 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:16.033674 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:16.033674 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:16.033674 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:16.033674 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.033674 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:16.034917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.034917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:16.034917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:16.034917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:16.034917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:16.034917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:16.034917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:16.034917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:16.034917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:16.034917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:16.034917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:16.034917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:16.034917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:16.034917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:52:16.034917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:16.034917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:16.034917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.035554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:16.046839 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:16.048033 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:16.048033 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:16.048168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.048815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:52:16.048815 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:16.048815 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:16.048815 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:16.048815 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:16.048815 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:16.048815 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.048815 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:16.049635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.049635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:16.049635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:16.049635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:16.049635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:16.049635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:16.049635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:16.049635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:16.049635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:16.049635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:16.049635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:16.049635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:16.049635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:16.049635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:52:16.049635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:16.049635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.050102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:16.164312 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:16.165207 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:52:16.166222 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:16.166222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.167032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:52:16.167032 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:16.167032 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:16.167032 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:16.167032 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:16.167032 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:16.167032 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.167032 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:16.168395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.168395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:16.168395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:16.168395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:16.168395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:16.168395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:16.168395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:16.168395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:16.168395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:16.168395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:16.168395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:16.168395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:16.168395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:16.168395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:16.168395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:16.169030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:16.169030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:16.169030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:16.169030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:16.169030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:16.169030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:16.169030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:16.169030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.169030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:16.169509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.169509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:16.169509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:16.169509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:16.169509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:16.169509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:16.169509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:16.169509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:16.169509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:16.169509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:16.169509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:16.169509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:16.169509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:16.169509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:52:16.169509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:52:16.169509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:16.169924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:16.170412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:16.170412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.170412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:16.367633 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:16.368219 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:16.368890 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:16.369250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.369949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:52:16.369949 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:16.369949 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:16.369949 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:16.369949 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:16.369949 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:16.369949 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.369949 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:16.371390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.371390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:16.371390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:16.371390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:16.371390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:16.371390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:16.371390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:16.371390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:16.371390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:16.371390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:16.371390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:16.371390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:16.371390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:16.371390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:16.371390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:16.371390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:16.371888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:16.371888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:16.371888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:16.371888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:16.371888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:16.371888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:16.371888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.371888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:16.374080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.374080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:16.374080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:16.374080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:16.374080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:16.374080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:16.374080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:16.374080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:16.374080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:16.374080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:16.374080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:16.374080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:16.374080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:16.374080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:52:16.374080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:52:16.374080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:16.374591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:16.375293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.375293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:16.439202 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:16.439202 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:16.439202 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:16.439202 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:16.439202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.439202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:52:16.439202 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:16.439202 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:16.439202 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:16.439202 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:16.441303 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:16.441303 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.441303 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:16.441303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.441303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:16.441303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:16.441303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:16.441303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:16.441303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:16.441303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:16.441303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:16.441303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:16.441303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:16.441303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:16.441303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:16.441303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:16.441303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:16.443443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:16.444373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:16.444373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:20.993703 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:20.995141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:21.011489 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=240 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:52:21.037184 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:21.037499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.038195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:52:21.038195 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:21.038195 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:21.038195 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:21.038195 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:21.038195 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:21.038195 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.038195 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:21.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:21.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:21.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:21.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:21.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:21.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:21.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:21.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:21.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:21.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:21.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:21.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:21.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:52:21.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:21.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:21.039576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.040469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:21.047490 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:21.048761 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:21.049100 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:21.049337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.050216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:52:21.050216 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:21.050216 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:21.050216 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:21.050216 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:21.050216 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:21.050216 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.050216 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:21.051797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.051797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:21.051797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:21.051797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:21.051797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:21.051797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:21.051797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:21.051797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:21.051797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:21.051797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:21.051797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:21.051797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:21.051797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:21.051797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:52:21.051797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:21.051797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.052349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:21.165082 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:21.165661 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:52:21.166170 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:21.166467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.167187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:52:21.167187 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:21.167187 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:21.167187 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:21.167187 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:21.167187 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:21.167187 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.167187 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:21.167825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.167825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:21.167825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:21.167825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:21.167825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:21.167825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:21.167825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:21.167825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:21.167825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:21.167825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:21.167825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:21.167825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:21.167825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:21.167825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:21.167825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:21.168462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:21.168462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:21.168462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:21.168462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:21.168462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:21.168462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:21.168462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:21.168462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.168462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:21.168825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.168825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:21.168825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:21.168825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:21.168825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:21.168825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:21.168825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:21.168825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:21.168825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:21.168825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:21.168825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:21.168825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:21.168825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:21.168825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:52:21.168825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:52:21.168825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:21.169379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:21.170270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:21.170270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.170270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:21.368344 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:21.368730 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:21.369515 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:21.369916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.370714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:52:21.370714 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:21.370714 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:21.370714 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:21.370714 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:21.370714 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:21.370714 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.370714 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:21.371604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.371604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:21.371604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:21.371604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:21.371604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:21.371604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:21.371604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:21.371604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:21.371604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:21.371604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:21.371604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:21.371604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:21.371604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:21.371604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:21.371604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:21.371604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:21.372085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:21.372085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:21.372085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:21.372085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:21.372085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:21.372085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:21.372085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.372085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:21.372753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.372753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:21.372753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:21.372753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:21.372753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:21.372753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:21.372753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:21.372753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:21.372753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:21.372753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:21.372753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:21.372753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:21.372753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:21.372753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:52:21.372753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:52:21.372753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:21.373280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:21.373838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.373838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:21.430145 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:21.430733 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:21.431106 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:21.431425 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:21.431659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.432420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:52:21.432420 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:21.432420 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:21.432420 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:21.432420 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:21.432420 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:21.432420 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.432420 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:21.433613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.433613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:21.433613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:21.433613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:21.433613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:21.433613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:21.433613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:21.433613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:21.433613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:21.433613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:21.433613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:21.433613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:21.433613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:21.433613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:52:21.433613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:21.433613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:21.433613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:21.434616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:25.994427 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:25.995710 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:26.035160 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:26.035661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.036605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:52:26.036605 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:26.036605 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:26.036605 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:26.036605 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:26.036605 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:26.036605 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.036605 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:26.037868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.037868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:26.037868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:26.037868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:26.037868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:26.037868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:26.037868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:26.037868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:26.037868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:26.037868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:26.037868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:26.037868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:26.037868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:26.037868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:52:26.037868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:26.037868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:26.037868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.038791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:26.049526 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:26.050758 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:26.051021 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:26.051215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.052232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:52:26.052232 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:26.052232 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:26.052232 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:26.052232 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:26.052232 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:26.052232 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.052232 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:26.053267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.053267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:26.053267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:26.053267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:26.053267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:26.053267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:26.053267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:26.053267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:26.053267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:26.053267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:26.053267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:26.053267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:26.053267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:26.053267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:52:26.053267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:26.053267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.053799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:26.165678 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:26.166344 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:52:26.166742 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:26.166902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.167502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:52:26.167502 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:26.167502 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:26.167502 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:26.167502 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:26.167502 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:26.167502 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.167502 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:26.168551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.168551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:26.168551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:26.168551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:26.168551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:26.168551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:26.168551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:26.168551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:26.168551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:26.168551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:26.168551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:26.168551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:26.168551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:26.168551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:26.168551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:26.169242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:26.169242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:26.169242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:26.169242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:26.169242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:26.169242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:26.169242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:26.169242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.169242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:26.170135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.170135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:26.170135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:26.170135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:26.170135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:26.170135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:26.170135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:26.170135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:26.170135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:26.170135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:26.170135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:26.170135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:26.170135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:26.170135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:52:26.170135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:52:26.170135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:26.171225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:26.171709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:26.171709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.171709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:26.369023 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:26.369282 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:26.370392 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:26.370654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.371375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:52:26.371375 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:26.371375 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:26.371375 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:26.371375 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:26.371375 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:26.371375 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.371375 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:26.372339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.372339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:26.372339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:26.372339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:26.372339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:26.372339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:26.372339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:26.372339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:26.372339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:26.372339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:26.372339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:26.372339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:26.372339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:26.372339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:26.372339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:26.372339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:26.372777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:26.372777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:26.372777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:26.372777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:26.372777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:26.372777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:26.372777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.372777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:26.373598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.373598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:26.373598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:26.373598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:26.373598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:26.373598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:26.373598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:26.373598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:26.373598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:26.373598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:26.373598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:26.373598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:26.373598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:26.373598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:52:26.373598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:52:26.373598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:26.374123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:26.374610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.374610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:26.431375 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:26.432087 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:26.432620 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:26.433033 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:26.433233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.434086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:52:26.434086 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:26.434086 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:26.434086 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:26.434086 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:26.434086 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:26.434086 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.434086 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:26.436774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.436774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:26.436774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:26.436774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:26.436774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:26.436774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:26.436774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:26.436774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:26.436774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:26.436774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:26.436774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:26.436774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:26.436774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:26.436774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:52:26.436774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:26.436774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:26.436774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:26.437463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:30.995191 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:30.996596 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:31.035054 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:31.035256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.036088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:52:31.036088 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:31.036088 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:31.036088 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:31.036088 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:31.036088 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:31.036088 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.036088 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:31.037261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.037261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:31.037261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:31.037261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:31.037261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:31.037261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:31.037261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:31.037261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:31.037261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:31.037261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:31.037261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:31.037261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:31.037261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:31.037261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:52:31.037261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:31.037261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:31.037261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.037914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:31.050403 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:31.051394 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:31.052199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:31.052199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.053204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:52:31.053204 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:31.053204 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:31.053204 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:31.053204 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:31.053204 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:31.053204 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.053204 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:31.054439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.054439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:31.054439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:31.054439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:31.054439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:31.054439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:31.054439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:31.054439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:31.054439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:31.054439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:31.054439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:31.054439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:31.054439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:31.054439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:52:31.054439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:31.054439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.055435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:31.166314 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:31.167296 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:52:31.168132 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:31.168526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.169178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:52:31.169178 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:31.169178 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:31.169178 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:31.169178 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:31.169178 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:31.169178 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.169178 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:31.170295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.170295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:31.170295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:31.170295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:31.170295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:31.170295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:31.170295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:31.170295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:31.170295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:31.170295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:31.170295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:31.170295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:31.170295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:31.170295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:31.170295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:31.171696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:31.171696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:31.171696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:31.171696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:31.171696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:31.171696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:31.171696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:31.171696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.171696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:31.171696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.171696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:31.171696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:31.171696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:31.171696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:31.171696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:31.173543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:31.174372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:31.174372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:31.174372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:31.174372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:31.174372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:31.174372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:31.174372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:31.174372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:31.174372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:31.174372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:31.174372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:31.174372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.174372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:31.369631 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:31.370062 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:31.371044 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:31.371867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.372204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:52:31.372204 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:31.372204 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:31.372204 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:31.372204 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:31.372204 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:31.372204 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.372204 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:31.373146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.373146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:31.373146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:31.373146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:31.373146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:31.373146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:31.373146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:31.373146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:31.373146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:31.373146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:31.373146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:31.373146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:31.373146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:31.373146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:31.373146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:31.373146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:31.374921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:31.374921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:31.374921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:31.374921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:31.374921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:31.374921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:31.374921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.374921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:31.374921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.374921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:31.374921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:31.374921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:31.374921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:31.374921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:31.374921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:31.374921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:31.376278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:31.377391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:31.377391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:31.377391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:31.377391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:31.377391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:31.377391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:31.377391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:31.377391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.377391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:31.432373 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:31.433153 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:31.433759 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:31.434281 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:31.434619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.435588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:52:31.435588 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:31.435588 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:31.435588 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:31.435588 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:31.435588 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:31.435588 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.435588 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:31.436834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.436834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:31.436834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:31.436834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:31.436834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:31.436834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:31.436834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:31.436834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:31.436834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:31.436834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:31.436834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:31.436834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:31.436834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:31.436834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:52:31.436834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:31.436834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:31.436834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:31.437795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:35.995607 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:35.996787 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:36.032847 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:36.033306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.034182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:52:36.034182 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:36.034182 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:36.034182 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:36.034182 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:36.034182 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:36.034182 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.034182 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:36.035416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.035416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:36.035416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:36.035416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:36.035416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:36.035416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:36.035416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:36.035416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:36.035416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:36.035416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:36.035416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:36.035416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:36.035416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:36.035416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:52:36.035416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:36.035416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:36.035416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.035837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:36.051351 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:36.053097 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:36.053434 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:36.053654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.054697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:52:36.054697 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:36.054697 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:36.054697 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:36.054697 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:36.054697 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:36.054697 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.054697 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:36.056188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.056188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:36.056188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:36.056188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:36.056188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:36.056188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:36.056188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:36.056188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:36.056188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:36.056188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:36.056188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:36.056188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:36.056188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:36.056188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:52:36.056188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:36.056188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.056814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:36.167487 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:36.168019 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:52:36.168701 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:36.168926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.169840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:52:36.169840 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:36.169840 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:36.169840 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:36.169840 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:36.169840 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:36.169840 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.169840 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:36.170631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.170631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:36.170631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:36.170631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:36.170631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:36.170631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:36.170631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:36.170631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:36.170631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:36.170631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:36.170631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:36.170631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:36.170631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:36.170631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:36.170631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:36.171159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:36.171159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:36.171159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:36.171159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:36.171159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:36.171159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:36.171159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:36.171159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.171159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:36.171731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.171731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:36.171731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:36.171731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:36.171731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:36.171731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:36.171731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:36.171731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:36.171731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:36.171731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:36.171731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:36.171731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:36.171731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:36.171731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:52:36.171731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:52:36.171731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:36.172488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:36.173281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:36.173281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.173281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:36.370437 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:36.371079 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:36.371725 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:36.372005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.372821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:52:36.372821 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:36.372821 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:36.372821 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:36.372821 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:36.372821 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:36.372821 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.372821 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:36.374024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.374024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:36.374024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:36.374024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:36.374024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:36.374024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:36.374024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:36.374024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:36.374024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:36.374024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:36.374024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:36.374024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:36.374024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:36.374024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:36.374024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:36.374024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:36.374689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:36.374689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:36.374689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:36.374689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:36.374689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:36.374689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:36.374689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.374689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:36.375582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.375582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:36.375582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:36.375582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:36.375582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:36.375582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:36.375582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:36.375582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:36.375582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:36.375582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:36.375582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:36.375582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:36.375582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:36.375582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:52:36.375582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:52:36.375582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:36.376263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:36.376940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.376940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:36.432921 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:36.433652 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:36.434134 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:36.434497 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:36.434653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.435504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:52:36.435504 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:36.435504 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:36.435504 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:36.435504 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:36.435504 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:36.435504 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.435504 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:36.436961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.436961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:36.436961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:36.436961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:36.436961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:36.436961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:36.436961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:36.436961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:36.436961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:36.436961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:36.436961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:36.436961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:36.436961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:36.436961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:52:36.436961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:36.436961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:36.436961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:36.437796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:40.996428 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:40.998485 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:41.030698 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:41.031192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.031716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:52:41.031716 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:41.031716 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:41.031716 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:41.031716 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:41.031716 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:41.031716 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.031716 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:41.032642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.032642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:41.032642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:41.032642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:41.032642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:41.032642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:41.032642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:41.032642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:41.032642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:41.032642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:41.032642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:41.032642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:41.032642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:41.032642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:52:41.032642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:41.032642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:41.032642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.033284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:41.052034 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:41.053290 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:41.053522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:41.053671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.054448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:52:41.054448 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:41.054448 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:41.054448 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:41.054448 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:41.054448 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:41.054448 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.054448 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:41.056296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.056296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:41.056296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:41.056296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:41.056296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:41.056296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:41.056296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:41.056296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:41.056296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:41.056296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:41.056296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:41.056296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:41.056296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:41.056296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:52:41.056296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:41.056296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.057146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:41.168109 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:41.168670 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:52:41.169551 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:41.169938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.171216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:52:41.171216 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:41.171216 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:41.171216 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:41.171216 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:41.171216 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:41.171216 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.171216 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:41.171921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.171921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:41.171921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:41.171921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:41.171921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:41.171921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:41.171921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:41.171921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:41.171921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:41.171921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:41.171921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:41.171921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:41.171921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:41.171921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:41.171921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:41.172762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:41.172762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:41.172762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:41.172762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:41.172762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:41.172762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:41.172762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:41.172762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.172762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:41.173199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.173199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:41.173199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:41.173199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:41.173199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:41.173199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:41.173199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:41.173199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:41.173199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:41.173199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:41.173199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:41.173199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:41.173199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:41.173199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:52:41.173199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:52:41.173199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:41.173660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:41.174171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:41.174171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.174171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:41.371225 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:41.371569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:41.372481 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:41.372920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.373649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:52:41.373649 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:41.373649 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:41.373649 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:41.373649 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:41.373649 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:41.373649 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.373649 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:41.374434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.374434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:41.374434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:41.374434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:41.374434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:41.374434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:41.374434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:41.374434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:41.374434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:41.374434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:41.374434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:41.374434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:41.374434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:41.374434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:41.374434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:41.374434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:41.375041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:41.375041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:41.375041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:41.375041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:41.375041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:41.375041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:41.375041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.375041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:41.375370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.375370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:41.375370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:41.375370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:41.375370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:41.375370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:41.375370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:41.375370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:41.375370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:41.375370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:41.375370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:41.375370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:41.375370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:41.375370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:52:41.375370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:52:41.375370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:41.376137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:41.376768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.376768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:41.433629 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:41.434208 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:41.434542 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:41.434782 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:41.434903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.435515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:52:41.435515 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:41.435515 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:41.435515 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:41.435515 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:41.435515 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:41.435515 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.435515 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:41.436564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.436564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:41.436564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:41.436564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:41.436564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:41.436564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:41.436564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:41.436564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:41.436564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:41.436564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:41.436564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:41.436564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:41.436564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:41.436564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:52:41.436564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:41.436564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:41.436564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:41.437544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:45.997097 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:45.998639 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:46.029742 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:46.030182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.031134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:52:46.031134 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:46.031134 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:46.031134 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:46.031134 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:46.031134 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:46.031134 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.031134 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:46.032037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.032037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:46.032037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:46.032037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:46.032037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:46.032037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:46.032037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:46.032037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:46.032037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:46.032037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:46.032037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:46.032037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:46.032037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:46.032037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:52:46.032037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:46.032037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:46.032037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.032549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:46.052565 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:46.053803 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:46.054088 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:46.054318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.055234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:52:46.055234 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:46.055234 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:46.055234 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:46.055234 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:46.055234 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:46.055234 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.055234 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:46.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:46.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:46.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:46.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:46.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:46.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:46.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:46.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:46.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:46.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:46.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:46.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:46.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:52:46.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:46.057650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.058236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:46.168824 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:46.169898 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:52:46.169898 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:46.170176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.170677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:52:46.170677 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:46.170677 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:46.170677 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:46.170677 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:46.170677 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:46.170677 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.170677 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:46.171555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.171555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:46.171555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:46.171555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:46.171555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:46.171555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:46.171555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:46.171555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:46.171555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:46.171555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:46.171555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:46.171555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:46.171555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:46.171555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:46.171555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:46.172236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:46.172236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:46.172236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:46.172236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:46.172236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:46.172236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:46.172236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:46.172236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.172236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:46.172633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.172633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:46.172633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:46.172633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:46.172633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:46.172633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:46.172633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:46.172633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:46.172633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:46.172633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:46.172633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:46.172633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:46.172633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:46.172633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:52:46.172633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:52:46.172633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:46.173316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:46.174050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:46.174050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.174050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:46.372216 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:46.373001 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:46.374848 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:46.375108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.375874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:52:46.375874 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:46.375874 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:46.375874 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:46.375874 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:46.375874 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:46.375874 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.375874 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:46.376736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.376736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:46.376736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:46.376736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:46.376736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:46.376736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:46.376736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:46.376736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:46.376736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:46.376736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:46.376736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:46.376736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:46.376736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:46.376736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:46.376736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:46.376736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:46.377471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:46.377471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:46.377471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:46.377471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:46.377471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:46.377471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:46.377471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.377471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:46.377833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.377833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:46.377833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:46.377833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:46.377833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:46.377833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:46.377833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:46.377833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:46.377833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:46.377833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:46.377833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:46.377833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:46.377833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:46.377833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:52:46.377833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:52:46.377833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:46.378422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:46.379127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.379127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:46.434371 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:46.435089 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:46.435368 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:46.435564 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:46.435682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.436145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:52:46.436145 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:46.436145 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:46.436145 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:46.436145 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:46.436145 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:46.436145 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.436145 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:46.437006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.437006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:46.437006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:46.437006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:46.437006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:46.437006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:46.437006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:46.437006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:46.437006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:46.437006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:46.437006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:46.437006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:46.437006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:46.437006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:52:46.437006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:46.437006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:46.437006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:46.437523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:50.997672 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:50.999758 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:51.038147 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:51.038590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.039795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:52:51.039795 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:51.039795 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:51.039795 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:51.039795 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:51.039795 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:51.039795 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.039795 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:51.041259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.041259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:51.041259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:51.041259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:51.041259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:51.041259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:51.041259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:51.041259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:51.041259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:51.041259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:51.041259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:51.041259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:51.041259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:51.041259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:52:51.041259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:51.041259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:51.041259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.042537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:51.053486 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:51.054586 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:51.054942 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:51.055209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.056214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:52:51.056214 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:51.056214 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:51.056214 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:51.056214 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:51.056214 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:51.056214 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.056214 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:51.057556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.057556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:51.057556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:51.057556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:51.057556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:51.057556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:51.057556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:51.057556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:51.057556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:51.057556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:51.057556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:51.057556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:51.057556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:51.057556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:52:51.057556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:51.057556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.057943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:51.169468 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:51.169739 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:52:51.170577 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:51.170921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.172907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:52:51.172907 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:51.172907 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:51.172907 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:51.172907 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:51.172907 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:51.172907 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.172907 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:51.174168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.174168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:51.174168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:51.174168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:51.174168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:51.174168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:51.174168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:51.174168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:51.174168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:51.174168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:51.174168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:51.174168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:51.174168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:51.174168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:51.174168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:51.174621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:51.174621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:51.174621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:51.174621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:51.174621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:51.174621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:51.174621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:51.174621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.174621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:51.175756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.175756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:51.175756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:51.175756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:51.175756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:51.175756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:51.175756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:51.175756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:51.175756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:51.175756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:51.175756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:51.175756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:51.175756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:51.175756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:52:51.175756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:52:51.175756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:51.176316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:51.176888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:51.176888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.176888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:51.372786 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:51.373233 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:51.373658 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:51.373946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.374497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:52:51.374497 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:51.374497 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:51.374497 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:51.374497 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:51.374497 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:51.374497 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.374497 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:51.375462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.375462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:51.375462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:51.375462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:51.375462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:51.375462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:51.375462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:51.375462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:51.375462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:51.375462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:51.375462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:51.375462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:51.375462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:51.375462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:51.375462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:51.375462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:51.376107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:51.376107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:51.376107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:51.376107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:51.376107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:51.376107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:51.376107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.376107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:51.376868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.376868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:51.376868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:51.376868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:51.376868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:51.376868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:51.376868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:51.376868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:51.376868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:51.376868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:51.376868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:51.376868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:51.376868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:51.376868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:52:51.376868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:52:51.376868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:51.377506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:51.378126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.378126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:51.435178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:51.435585 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:51.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:51.436251 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:51.436420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.436998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:52:51.436998 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:51.436998 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:51.436998 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:51.436998 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:51.436998 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:51.436998 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.436998 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:51.438138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.438138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:51.438138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:51.438138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:51.438138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:51.438138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:51.438138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:51.438138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:51.438138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:51.438138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:51.438138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:51.438138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:51.438138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:51.438138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:52:51.438138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:51.438138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:51.438138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:51.438567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:55.998303 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:55.999548 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:56.042056 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:56.043067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.044112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:52:56.044112 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:56.044112 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:56.044112 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:56.044112 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:56.044112 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:56.044112 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.044112 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:56.046091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.046091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:56.046091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:56.046091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:56.046091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:56.046091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:56.046091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:56.046091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:56.046091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:56.046091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:56.046091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:56.046091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:56.046091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:56.046091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:52:56.046091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:56.046091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:56.046091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.046734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:56.054092 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:56.054917 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:56.055282 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:56.055517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.056260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:52:56.056260 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:56.056260 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:56.056260 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:56.056260 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:56.056260 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:56.056260 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.056260 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:56.057055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.057055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:56.057055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:56.057055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:56.057055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:56.057055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:56.057055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:56.057055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:56.057055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:56.057055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:56.057055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:56.057055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:56.057055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:56.057055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:52:56.057055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:56.057055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.057509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:56.170296 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:56.170946 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:52:56.171438 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:56.171703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.172342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:52:56.172342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:56.172342 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:56.172342 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:56.172342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:56.172342 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:56.172342 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.172342 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:56.173175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.173175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:56.173175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:56.173175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:56.173175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:56.173175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:56.173175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:56.173175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:56.173175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:56.173175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:56.173175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:56.173175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:56.173175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:56.173175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:56.173175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:56.173627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:56.173627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:56.173627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:56.173627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:56.173627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:56.173627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:56.173627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:56.173627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.173627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:56.173932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.173932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:56.173932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:56.173932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:56.173932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:56.173932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:56.173932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:56.173932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:56.173932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:56.173932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:56.173932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:56.173932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:56.173932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:56.173932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:52:56.173932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:52:56.173932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:56.174777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:56.175667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:56.175667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.175667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:56.373663 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:56.373932 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:56.374457 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:56.374830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.375593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:52:56.375593 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:56.375593 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:56.375593 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:56.375593 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:56.375593 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:56.375593 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.375593 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:56.376077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.376077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:52:56.376077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:56.376077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:56.376077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:56.376077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:56.376077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:56.376077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:56.376077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:56.376077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:52:56.376077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:56.376077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:52:56.376077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:56.376077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:52:56.376077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:52:56.376077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:56.376528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:52:56.376528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:56.376528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:52:56.376528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:52:56.376528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:56.376528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:52:56.376528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.376528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:52:56.376810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.376810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:56.376810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:56.376810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:56.376810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:56.376810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:56.376810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:56.376810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:56.376810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:56.376810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:56.376810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:56.376810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:56.376810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:56.376810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:52:56.376810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:52:56.376810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:56.377286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:56.377756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.377756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:52:56.435677 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:52:56.436194 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:52:56.436604 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:56.437031 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:52:56.437225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.438033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:52:56.438033 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:56.438033 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:52:56.438033 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:52:56.438033 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:56.438033 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:52:56.438033 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.438033 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:52:56.439733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.439733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:52:56.439733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:52:56.439733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:52:56.439733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:52:56.439733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:52:56.439733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:56.439733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:52:56.439733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:52:56.439733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:52:56.439733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:52:56.439733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:52:56.439733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:52:56.439733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:52:56.439733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:52:56.439733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:56.439733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:52:56.440256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:00.998826 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:01.000102 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:01.034584 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:01.034793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.036026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:53:01.036026 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:01.036026 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:01.036026 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:01.036026 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:01.036026 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:01.036026 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.036026 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:01.037088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.037088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:01.037088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:01.037088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:01.037088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:01.037088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:01.037088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:01.037088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:01.037088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:01.037088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:01.037088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:01.037088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:01.037088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:01.037088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:53:01.037088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:01.037088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:01.037088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.037612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:01.054653 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:01.056490 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:01.057118 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:01.057118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.058292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:53:01.058292 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:01.058292 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:01.058292 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:01.058292 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:01.058292 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:01.058292 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.058292 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:01.060152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.060152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:01.060152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:01.060152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:01.060152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:01.060152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:01.060152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:01.060152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:01.060152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:01.060152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:01.060152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:01.060152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:01.060152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:01.060152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:53:01.060152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:01.060152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.060539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:01.170726 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:01.172318 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:53:01.172717 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:01.172922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.173835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:53:01.173835 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:01.173835 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:01.173835 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:01.173835 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:01.173835 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:01.173835 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.173835 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:01.177713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.177713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:01.177713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:01.177713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:01.177713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:01.177713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:01.177713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:01.177713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:01.177713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:01.177713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:01.177713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:01.177713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:01.177713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:01.177713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:01.177713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:01.178531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:01.178531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:01.178531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:01.178531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:01.178531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:01.178531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:01.178531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:01.178531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.178531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:01.179052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.179052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:01.179052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:01.179052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:01.179052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:01.179052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:01.179052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:01.179052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:01.179052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:01.179052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:01.179052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:01.179052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:01.179052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:01.179052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:53:01.179052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:53:01.179052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:01.179719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:01.180522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:01.180522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.180522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:01.374075 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:01.374341 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:01.374788 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:01.375112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.375785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:53:01.375785 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:01.375785 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:01.375785 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:01.375785 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:01.375785 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:01.375785 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.375785 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:01.376591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.376591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:01.376591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:01.376591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:01.376591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:01.376591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:01.376591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:01.376591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:01.376591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:01.376591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:01.376591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:01.376591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:01.376591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:01.376591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:01.376591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:01.376591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:01.377122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:01.377122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:01.377122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:01.377122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:01.377122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:01.377122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:01.377122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.377122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:01.378457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.378457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:01.378457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:01.378457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:01.378457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:01.378457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:01.378457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:01.378457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:01.378457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:01.378457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:01.378457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:01.378457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:01.378457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:01.378457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:53:01.378457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:53:01.378457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:01.378962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:01.379578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.379578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:01.436342 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:01.437059 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:01.437488 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:01.437825 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:01.438035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.438684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:53:01.438684 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:01.438684 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:01.438684 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:01.438684 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:01.438684 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:01.438684 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.438684 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:01.439928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.439928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:01.439928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:01.439928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:01.439928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:01.439928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:01.439928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:01.439928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:01.439928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:01.439928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:01.439928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:01.439928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:01.439928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:01.439928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:53:01.439928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:01.439928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:01.439928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:01.440682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:05.999572 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:06.001314 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:06.038494 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:06.038789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.039267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:53:06.039267 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:06.039267 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:06.039267 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:06.039267 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:06.039267 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:06.039267 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.039267 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:06.040356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.040356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:06.040356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:06.040356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:06.040356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:06.040356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:06.040356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:06.040356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:06.040356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:06.040356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:06.040356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:06.040356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:06.040356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:06.040356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:53:06.040356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:06.040356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:06.040356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.040882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:06.056003 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:06.057635 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:06.057911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:06.058123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.059185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:53:06.059185 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:06.059185 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:06.059185 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:06.059185 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:06.059185 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:06.059185 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.059185 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:06.060684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.060684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:06.060684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:06.060684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:06.060684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:06.060684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:06.060684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:06.060684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:06.060684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:06.060684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:06.060684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:06.060684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:06.060684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:06.060684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:53:06.060684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:06.060684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.061455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:06.172098 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:06.172560 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:53:06.173064 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:06.173284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.173766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:53:06.173766 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:06.173766 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:06.173766 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:06.173766 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:06.173766 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:06.173766 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.173766 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:06.174430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.174430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:06.174430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:06.174430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:06.174430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:06.174430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:06.174430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:06.174430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:06.174430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:06.174430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:06.174430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:06.174430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:06.174430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:06.174430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:06.174430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:06.175000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:06.175000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:06.175000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:06.175000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:06.175000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:06.175000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:06.175000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:06.175000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.175000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:06.175299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.175299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:06.175299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:06.175299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:06.175299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:06.175299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:06.175299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:06.175299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:06.175299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:06.175299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:06.175299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:06.175299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:06.175299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:06.175299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:53:06.175299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:53:06.175299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:06.175777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:06.176366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:06.176366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.176366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:06.374763 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:06.375107 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:06.375712 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:06.376894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.376894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:53:06.376894 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:06.376894 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:06.376894 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:06.376894 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:06.376894 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:06.376894 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.376894 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:06.377912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.377912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:06.377912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:06.377912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:06.377912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:06.377912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:06.377912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:06.377912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:06.377912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:06.377912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:06.377912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:06.377912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:06.377912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:06.377912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:06.377912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:06.377912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:06.378587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:06.378587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:06.378587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:06.378587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:06.378587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:06.378587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:06.378587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.378587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:06.379619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.379619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:06.379619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:06.379619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:06.379619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:06.379619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:06.379619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:06.379619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:06.379619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:06.379619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:06.379619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:06.379619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:06.379619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:06.379619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:53:06.379619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:53:06.379619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:06.380254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:06.380631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.380631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:06.438904 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:06.440125 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:06.440499 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:06.441252 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:06.441252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.442133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:53:06.442133 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:06.442133 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:06.442133 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:06.442133 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:06.442133 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:06.442133 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.442133 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:06.443429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.443429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:06.443429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:06.443429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:06.443429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:06.443429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:06.443429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:06.443429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:06.443429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:06.443429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:06.443429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:06.443429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:06.443429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:06.443429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:53:06.443429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:06.443429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:06.443429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:06.444458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:11.000598 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:11.002675 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:11.043323 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:11.043578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.044309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:53:11.044309 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:11.044309 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:11.044309 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:11.044309 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:11.044309 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:11.044309 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.044309 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:11.045636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.045636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:11.045636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:11.045636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:11.045636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:11.045636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:11.045636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:11.045636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:11.045636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:11.045636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:11.045636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:11.045636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:11.045636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:11.045636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:53:11.045636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:11.045636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:11.045636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.046048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:11.056655 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:11.057521 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:11.057823 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:11.058005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.058860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:53:11.058860 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:11.058860 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:11.058860 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:11.058860 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:11.058860 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:11.058860 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.058860 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:11.060198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.060198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:11.060198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:11.060198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:11.060198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:11.060198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:11.060198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:11.060198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:11.060198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:11.060198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:11.060198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:11.060198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:11.060198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:11.060198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:53:11.060198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:11.060198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.060719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:11.172673 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:11.173206 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:53:11.174085 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:11.174402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.175080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:53:11.175080 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:11.175080 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:11.175080 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:11.175080 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:11.175080 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:11.175080 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.175080 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:11.175948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.175948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:11.175948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:11.175948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:11.175948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:11.175948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:11.175948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:11.175948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:11.175948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:11.175948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:11.175948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:11.175948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:11.175948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:11.175948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:11.175948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:11.176383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:11.176383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:11.176383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:11.176383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:11.176383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:11.176383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:11.176383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:11.176383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.176383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:11.177304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.177304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:11.177304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:11.177304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:11.177304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:11.177304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:11.177304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:11.177304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:11.177304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:11.177304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:11.177304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:11.177304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:11.177304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:11.177304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:53:11.177304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:53:11.177304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:11.177756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:11.178210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:11.178210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.178210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:11.375358 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:11.375735 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:11.376181 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:11.376433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.376937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:53:11.376937 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:11.376937 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:11.376937 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:11.376937 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:11.376937 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:11.376937 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.376937 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:11.377634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.377634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:11.377634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:11.377634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:11.377634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:11.377634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:11.377634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:11.377634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:11.377634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:11.377634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:11.377634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:11.377634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:11.377634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:11.377634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:11.377634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:11.377634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:11.378028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:11.378028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:11.378028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:11.378028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:11.378028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:11.378028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:11.378028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.378028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:11.378829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.378829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:11.378829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:11.378829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:11.378829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:11.378829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:11.378829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:11.378829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:11.378829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:11.378829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:11.378829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:11.378829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:11.378829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:11.378829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:53:11.378829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:53:11.378829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:11.379213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:11.379598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.379598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:11.439576 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:11.439967 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:11.440651 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:11.441514 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:11.441514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.441982 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:53:11.441982 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:11.441982 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:11.441982 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:11.441982 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:11.441982 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:11.441982 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.441982 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:11.443154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.443154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:11.443154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:11.443154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:11.443154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:11.443154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:11.443154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:11.443154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:11.443154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:11.443154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:11.443154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:11.443154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:11.443154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:11.443154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:53:11.443154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:11.443154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:11.443154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:11.443529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:16.001219 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:16.002336 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:16.038714 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:16.039025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:16.040790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:16.042720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:16.044498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:16.044498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:16.044498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:16.044498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:16.044498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.044498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:16.057254 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:16.058157 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:16.058386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:16.058531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:16.060424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:16.061018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:16.061505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:16.061505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:16.061505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:16.061505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:16.061505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.061505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:16.173345 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:16.174518 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:53:16.175146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:16.175372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.175941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:53:16.175941 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:16.175941 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:16.175941 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:16.175941 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:16.175941 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:16.175941 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.175941 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:16.176945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.176945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:16.176945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:16.176945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:16.176945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:16.176945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:16.176945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:16.176945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:16.176945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:16.176945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:16.176945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:16.176945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:16.176945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:16.176945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:16.176945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:16.177656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:16.177656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:16.177656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:16.177656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:16.177656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:16.177656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:16.177656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:16.177656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.177656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:16.178127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.178127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:16.178127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:16.178127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:16.178127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:16.178127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:16.178127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:16.178127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:16.178127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:16.178127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:16.178127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:16.178127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:16.178127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:16.178127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:53:16.178127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:53:16.178127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:16.178760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:16.179432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:16.179432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.179432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:16.375858 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:16.376616 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:16.377512 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:16.378154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.379468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:53:16.379468 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:16.379468 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:16.379468 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:16.379468 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:16.379468 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:16.379468 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.379468 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:16.380903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.380903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:16.380903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:16.380903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:16.380903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:16.380903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:16.380903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:16.380903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:16.380903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:16.380903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:16.380903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:16.380903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:16.380903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:16.380903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:16.380903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:16.380903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:16.381696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:16.381696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:16.381696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:16.381696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:16.381696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:16.381696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:16.381696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.381696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:16.383476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.383476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:16.383476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:16.383476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:16.383476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:16.383476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:16.383476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:16.383476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:16.383476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:16.383476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:16.383476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:16.383476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:16.383476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:16.383476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:53:16.383476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:53:16.383476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:16.384322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:16.384850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.384850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:16.440300 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:16.440597 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:16.441796 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:16.442095 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:16.442240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.442873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:53:16.442873 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:16.442873 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:16.442873 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:16.442873 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:16.442873 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:16.442873 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.442873 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:16.444360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.444360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:16.444360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:16.444360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:16.444360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:16.444360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:16.444360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:16.444360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:16.444360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:16.444360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:16.444360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:16.444360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:16.444360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:16.444360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:53:16.444360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:16.444360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:16.444360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:16.444907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:21.002025 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:21.003511 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:21.017734 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=240 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:53:21.041215 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:21.041732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.042972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:53:21.042972 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:21.042972 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:21.042972 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:21.042972 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:21.042972 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:21.042972 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.042972 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:21.044406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.044406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:21.044406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:21.044406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:21.044406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:21.044406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:21.044406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:21.044406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:21.044406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:21.044406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:21.044406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:21.044406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:21.044406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:21.044406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:53:21.044406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:21.044406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:21.044406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.045091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:21.058187 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:21.059673 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:21.060222 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:21.060541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.062691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:53:21.062691 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:21.062691 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:21.062691 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:21.062691 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:21.062691 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:21.062691 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.062691 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:21.064133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.064133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:21.064133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:21.064133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:21.064133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:21.064133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:21.064133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:21.064133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:21.064133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:21.064133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:21.064133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:21.064133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:21.064133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:21.064133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:53:21.064133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:21.064133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.065012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:21.174499 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:21.174937 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:53:21.175377 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:21.175554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.176003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:53:21.176003 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:21.176003 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:21.176003 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:21.176003 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:21.176003 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:21.176003 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.176003 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:21.176571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.176571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:21.176571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:21.176571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:21.176571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:21.176571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:21.176571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:21.176571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:21.176571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:21.176571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:21.176571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:21.176571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:21.176571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:21.176571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:21.176571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:21.177176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:21.177176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:21.177176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:21.177176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:21.177176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:21.177176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:21.177176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:21.177176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.177176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:21.177550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.177550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:21.177550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:21.177550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:21.177550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:21.177550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:21.177550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:21.177550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:21.177550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:21.177550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:21.177550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:21.177550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:21.177550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:21.177550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:53:21.177550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:53:21.177550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:21.178245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:21.178938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:21.178938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.178938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:21.376456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:21.376653 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:21.377015 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:21.377279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.377977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:53:21.377977 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:21.377977 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:21.377977 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:21.377977 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:21.377977 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:21.377977 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.377977 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:21.378756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.378756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:21.378756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:21.378756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:21.378756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:21.378756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:21.378756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:21.378756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:21.378756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:21.378756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:21.378756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:21.378756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:21.378756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:21.378756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:21.378756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:21.378756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:21.379649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:21.379649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:21.379649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:21.379649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:21.379649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:21.379649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:21.379649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.379649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:21.380622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.380622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:21.380622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:21.380622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:21.380622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:21.380622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:21.380622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:21.380622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:21.380622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:21.380622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:21.380622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:21.380622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:21.380622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:21.380622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:53:21.380622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:53:21.380622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:21.381668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:21.382692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.382692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:21.441002 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:21.441700 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:21.442488 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:21.442911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:21.443097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.443695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:53:21.443695 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:21.443695 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:21.443695 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:21.443695 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:21.443695 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:21.443695 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.443695 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:21.444899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.444899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:21.444899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:21.444899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:21.444899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:21.444899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:21.444899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:21.444899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:21.444899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:21.444899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:21.444899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:21.444899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:21.444899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:21.444899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:53:21.444899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:21.444899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:21.444899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:21.446223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:26.002813 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:26.003895 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:26.047037 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:26.047282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.048197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:53:26.048197 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:26.048197 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:26.048197 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:26.048197 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:26.048197 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:26.048197 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.048197 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:26.049266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.049266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:26.049266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:26.049266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:26.049266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:26.049266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:26.049266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:26.049266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:26.049266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:26.049266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:26.049266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:26.049266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:26.049266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:26.049266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:53:26.049266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:26.049266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:26.049266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.049823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:26.058680 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:26.059932 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:26.059932 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:26.059932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.060174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:53:26.060174 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:26.060174 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:26.060174 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:26.060174 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:26.060174 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:26.060174 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.060174 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:26.061344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.061344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:26.061344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:26.061344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:26.061344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:26.061344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:26.061344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:26.061344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:26.061344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:26.061344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:26.061344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:26.061344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:26.061344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:26.061344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:53:26.061344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:26.061344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.061731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:26.175132 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:26.175736 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:53:26.176606 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:26.176792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.177953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:53:26.177953 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:26.177953 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:26.177953 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:26.177953 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:26.177953 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:26.177953 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.177953 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:26.178443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.178443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:26.178443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:26.178443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:26.178443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:26.178443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:26.178443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:26.178443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:26.178443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:26.178443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:26.178443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:26.178443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:26.178443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:26.178443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:26.178443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:26.178921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:26.178921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:26.178921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:26.178921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:26.178921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:26.178921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:26.178921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:26.178921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.178921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:26.179327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.179327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:26.179327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:26.179327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:26.179327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:26.179327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:26.179327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:26.179327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:26.179327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:26.179327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:26.179327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:26.179327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:26.179327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:26.179327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:53:26.179327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:53:26.179327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:26.180098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:26.180848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:26.180848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.180848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:26.377139 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:26.377723 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:26.378192 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:26.378458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.379051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:53:26.379051 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:26.379051 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:26.379051 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:26.379051 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:26.379051 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:26.379051 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.379051 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:26.379827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.379827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:26.379827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:26.379827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:26.379827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:26.379827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:26.379827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:26.379827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:26.379827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:26.379827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:26.379827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:26.379827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:26.379827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:26.379827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:26.379827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:26.379827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:26.380722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:26.380722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:26.380722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:26.380722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:26.380722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:26.380722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:26.380722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.380722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:26.381231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.381231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:26.381231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:26.381231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:26.381231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:26.381231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:26.381231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:26.381231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:26.381231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:26.381231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:26.381231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:26.381231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:26.381231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:26.381231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:53:26.381231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:53:26.381231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:26.382174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:26.383126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.383126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:26.441767 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:26.442141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:26.442467 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:26.442864 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:26.442864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.443431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:53:26.443431 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:26.443431 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:26.443431 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:26.443431 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:26.443431 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:26.443431 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.443431 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:26.444830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.444830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:26.444830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:26.444830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:26.444830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:26.444830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:26.444830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:26.444830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:26.444830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:26.444830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:26.444830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:26.444830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:26.444830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:26.444830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:53:26.444830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:26.444830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:26.444830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:26.446300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:31.003458 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:31.004524 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:31.036177 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:31.036483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.037118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:53:31.037118 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:31.037118 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:31.037118 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:31.037118 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:31.037118 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:31.037118 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.037118 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:31.038308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.038308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:31.038308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:31.038308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:31.038308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:31.038308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:31.038308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:31.038308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:31.038308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:31.038308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:31.038308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:31.038308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:31.038308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:31.038308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:53:31.038308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:31.038308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:31.038308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.038890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:31.059788 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:31.060677 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:31.061061 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:31.061319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.062339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:53:31.062339 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:31.062339 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:31.062339 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:31.062339 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:31.062339 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:31.062339 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.062339 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:31.063511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.063511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:31.063511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:31.063511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:31.063511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:31.063511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:31.063511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:31.063511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:31.063511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:31.063511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:31.063511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:31.063511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:31.063511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:31.063511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:53:31.063511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:31.063511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.064104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:31.175693 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:31.176232 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:53:31.176817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:31.177170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.178844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:53:31.178844 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:31.178844 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:31.178844 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:31.178844 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:31.178844 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:31.178844 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.178844 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:31.179567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.179567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:31.179567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:31.179567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:31.179567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:31.179567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:31.179567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:31.179567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:31.179567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:31.179567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:31.179567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:31.179567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:31.179567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:31.179567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:31.179567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:31.180057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:31.180057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:31.180057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:31.180057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:31.180057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:31.180057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:31.180057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:31.180057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.180057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:31.180558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.180558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:31.180558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:31.180558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:31.180558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:31.180558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:31.180558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:31.180558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:31.180558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:31.180558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:31.180558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:31.180558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:31.180558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:31.180558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:53:31.180558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:53:31.180558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:31.181174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:31.181895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:31.181895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.181895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:31.378023 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:31.378230 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:31.378852 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:31.379069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.379688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:53:31.379688 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:31.379688 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:31.379688 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:31.379688 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:31.379688 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:31.379688 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.379688 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:31.381278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.381278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:31.381278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:31.381278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:31.381278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:31.381278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:31.381278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:31.381278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:31.381278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:31.381278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:31.381278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:31.381278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:31.381278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:31.381278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:31.381278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:31.381278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:31.382163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:31.382163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:31.382163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:31.382163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:31.382163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:31.382163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:31.382163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.382163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:31.383373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.383373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:31.383373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:31.383373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:31.383373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:31.383373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:31.383373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:31.383373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:31.383373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:31.383373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:31.383373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:31.383373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:31.383373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:31.383373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:53:31.383373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:53:31.383373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:31.383870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:31.384461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.384461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:31.442463 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:31.442865 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:31.443400 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:31.443658 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:31.444122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.444386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:53:31.444386 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:31.444386 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:31.444386 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:31.444386 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:31.444386 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:31.444386 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.444386 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:31.445429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.445429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:31.445429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:31.445429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:31.445429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:31.445429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:31.445429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:31.445429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:31.445429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:31.445429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:31.445429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:31.445429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:31.445429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:31.445429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:53:31.445429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:31.445429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:31.445429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:31.446268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:36.004021 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:36.006050 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:36.046423 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:36.046641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.047290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:53:36.047290 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:36.047290 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:36.047290 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:36.047290 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:36.047290 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:36.047290 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.047290 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:36.048333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.048333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:36.048333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:36.048333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:36.048333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:36.048333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:36.048333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:36.048333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:36.048333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:36.048333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:36.048333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:36.048333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:36.048333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:36.048333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:53:36.048333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:36.048333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:36.048333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.048942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:36.059918 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:36.061107 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:36.061358 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:36.061551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.062549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:53:36.062549 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:36.062549 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:36.062549 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:36.062549 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:36.062549 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:36.062549 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.062549 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:36.064205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.064205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:36.064205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:36.064205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:36.064205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:36.064205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:36.064205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:36.064205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:36.064205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:36.064205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:36.064205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:36.064205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:36.064205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:36.064205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:53:36.064205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:36.064205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.064879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:36.176309 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:36.176753 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:53:36.177184 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:36.177313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.178020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:53:36.178020 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:36.178020 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:36.178020 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:36.178020 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:36.178020 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:36.178020 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.178020 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:36.179225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.179225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:36.179225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:36.179225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:36.179225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:36.179225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:36.179225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:36.179225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:36.179225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:36.179225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:36.179225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:36.179225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:36.179225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:36.179225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:36.179225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:36.179677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:36.179677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:36.179677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:36.179677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:36.179677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:36.179677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:36.179677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:36.179677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.179677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:36.180525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.180525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:36.180525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:36.180525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:36.180525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:36.180525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:36.180525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:36.180525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:36.180525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:36.180525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:36.180525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:36.180525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:36.180525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:36.180525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:53:36.180525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:53:36.180525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:36.180849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:36.181207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:36.181207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.181207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:36.378734 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:36.379695 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:36.380538 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:36.381021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.382198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:53:36.382198 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:36.382198 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:36.382198 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:36.382198 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:36.382198 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:36.382198 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.382198 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:36.384066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.384066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:36.384066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:36.384066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:36.384066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:36.384066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:36.384066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:36.384066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:36.384066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:36.384066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:36.384066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:36.384066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:36.384066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:36.384066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:36.384066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:36.384066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:36.385157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:36.385157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:36.385157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:36.385157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:36.385157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:36.385157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:36.385157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.385157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:36.385944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.385944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:36.385944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:36.385944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:36.385944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:36.385944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:36.385944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:36.385944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:36.385944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:36.385944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:36.385944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:36.385944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:36.385944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:36.385944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:53:36.385944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:53:36.385944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:36.386927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:36.388309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.388309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:36.443130 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:36.443788 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:36.444547 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:36.444910 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:36.445207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.445728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:53:36.445728 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:36.445728 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:36.445728 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:36.445728 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:36.445728 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:36.445728 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.445728 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:36.446975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.446975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:36.446975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:36.446975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:36.446975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:36.446975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:36.446975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:36.446975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:36.446975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:36.446975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:36.446975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:36.446975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:36.446975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:36.446975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:53:36.446975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:36.446975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:36.446975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:36.447677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:41.005455 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:41.006634 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:41.048866 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:41.049386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.050342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:53:41.050342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:41.050342 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:41.050342 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:41.050342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:41.050342 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:41.050342 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.050342 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:41.051317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.051317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:41.051317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:41.051317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:41.051317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:41.051317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:41.051317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:41.051317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:41.051317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:41.051317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:41.051317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:41.051317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:41.051317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:41.051317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:53:41.051317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:41.051317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:41.051317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.051954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:41.060593 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:41.061593 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:41.061835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:41.062001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.062660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:53:41.062660 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:41.062660 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:41.062660 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:41.062660 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:41.062660 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:41.062660 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.062660 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:41.063821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.063821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:41.063821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:41.063821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:41.063821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:41.063821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:41.063821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:41.063821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:41.063821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:41.063821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:41.063821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:41.063821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:41.063821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:41.063821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:53:41.063821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:41.063821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.064307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:41.177075 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:41.177559 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:53:41.178293 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:41.178531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.179061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:53:41.179061 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:41.179061 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:41.179061 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:41.179061 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:41.179061 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:41.179061 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.179061 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:41.179916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.179916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:41.179916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:41.179916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:41.179916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:41.179916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:41.179916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:41.179916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:41.179916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:41.179916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:41.179916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:41.179916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:41.179916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:41.179916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:41.179916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:41.180665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:41.180665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:41.180665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:41.180665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:41.180665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:41.180665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:41.180665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:41.180665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.180665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:41.181095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.181095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:41.181095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:41.181095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:41.181095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:41.181095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:41.181095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:41.181095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:41.181095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:41.181095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:41.181095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:41.181095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:41.181095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:41.181095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:53:41.181095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:53:41.181095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:41.181764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:41.182538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:41.182538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.182538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:41.379769 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:41.380203 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:41.381002 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:41.381556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.382720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:53:41.382720 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:41.382720 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:41.382720 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:41.382720 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:41.382720 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:41.382720 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.382720 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:41.384043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.384043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:41.384043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:41.384043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:41.384043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:41.384043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:41.384043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:41.384043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:41.384043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:41.384043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:41.384043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:41.384043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:41.384043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:41.384043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:41.384043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:41.384043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:41.384757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:41.384757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:41.384757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:41.384757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:41.384757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:41.384757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:41.384757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.384757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:41.385756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.385756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:41.385756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:41.385756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:41.385756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:41.385756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:41.385756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:41.385756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:41.385756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:41.385756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:41.385756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:41.385756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:41.385756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:41.385756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:53:41.385756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:53:41.385756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:41.386435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:41.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:41.443765 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:41.444567 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:41.445585 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:41.446065 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:41.446330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.447340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:53:41.447340 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:41.447340 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:41.447340 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:41.447340 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:41.447340 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:41.447340 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.447340 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:41.449885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.449885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:41.449885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:41.449885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:41.449885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:41.449885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:41.449885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:41.449885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:41.449885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:41.449885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:41.449885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:41.449885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:41.449885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:41.449885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:53:41.449885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:41.449885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:41.449885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:41.450744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:46.006181 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:46.007703 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:46.043761 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:46.044092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.044747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:53:46.044747 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:46.044747 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:46.044747 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:46.044747 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:46.044747 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:46.044747 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.044747 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:46.045760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.045760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:46.045760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:46.045760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:46.045760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:46.045760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:46.045760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:46.045760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:46.045760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:46.045760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:46.045760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:46.045760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:46.045760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:46.045760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:53:46.045760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:46.045760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:46.045760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.046418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:46.061299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:46.062294 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:46.062480 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:46.062639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.063349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:53:46.063349 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:46.063349 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:46.063349 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:46.063349 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:46.063349 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:46.063349 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.063349 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:46.064500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.064500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:46.064500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:46.064500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:46.064500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:46.064500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:46.064500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:46.064500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:46.064500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:46.064500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:46.064500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:46.064500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:46.064500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:46.064500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:53:46.064500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:46.064500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.065036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:46.177727 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:46.178448 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:53:46.179317 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:46.179611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.180410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:53:46.180410 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:46.180410 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:46.180410 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:46.180410 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:46.180410 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:46.180410 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.180410 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:46.181274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.181274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:46.181274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:46.181274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:46.181274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:46.181274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:46.181274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:46.181274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:46.181274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:46.181274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:46.181274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:46.181274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:46.181274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:46.181274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:46.181274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:46.181860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:46.181860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:46.181860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:46.181860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:46.181860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:46.181860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:46.181860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:46.181860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.181860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:46.182424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.182424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:46.182424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:46.182424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:46.182424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:46.182424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:46.182424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:46.182424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:46.182424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:46.182424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:46.182424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:46.182424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:46.182424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:46.182424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:53:46.182424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:53:46.182424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:46.183068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:46.183602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:46.183602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.183602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:46.380493 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:46.380922 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:46.381456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:46.381681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.382411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:53:46.382411 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:46.382411 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:46.382411 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:46.382411 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:46.382411 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:46.382411 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.382411 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:46.383172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.383172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:46.383172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:46.383172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:46.383172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:46.383172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:46.383172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:46.383172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:46.383172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:46.383172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:46.383172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:46.383172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:46.383172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:46.383172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:46.383172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:46.383172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:46.384301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:46.384301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:46.384301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:46.384301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:46.384301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:46.384301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:46.384301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.384301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:46.384301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.384301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:46.384301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:46.384301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:46.384301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:46.384301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:46.384301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:46.384301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:46.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:46.386566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:46.386566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:46.386566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:46.386566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:46.386566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:46.386566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:46.386566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:46.386566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.386566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:46.444365 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:46.445182 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:46.446094 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:46.446257 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:46.446459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.447360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:53:46.447360 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:46.447360 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:46.447360 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:46.447360 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:46.447360 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:46.447360 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.447360 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:46.449043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.449043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:46.449043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:46.449043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:46.449043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:46.449043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:46.449043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:46.449043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:46.449043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:46.449043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:46.449043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:46.449043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:46.449043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:46.449043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:53:46.449043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:46.449043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:46.449043 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:46.449576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:51.007299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:51.009165 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:51.050519 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:51.050880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.051790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:53:51.051790 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:51.051790 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:51.051790 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:51.051790 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:51.051790 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:51.051790 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.051790 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:51.053098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.053098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:51.053098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:51.053098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:51.053098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:51.053098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:51.053098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:51.053098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:51.053098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:51.053098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:51.053098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:51.053098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:51.053098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:51.053098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:53:51.053098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:51.053098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:51.053098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.054014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:51.061911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:51.063416 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:51.063637 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:51.063763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.064599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:53:51.064599 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:51.064599 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:51.064599 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:51.064599 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:51.064599 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:51.064599 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.064599 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:51.065955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.065955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:51.065955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:51.065955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:51.065955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:51.065955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:51.065955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:51.065955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:51.065955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:51.065955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:51.065955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:51.065955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:51.065955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:51.065955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:53:51.065955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:51.065955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.066424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:51.178513 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:51.179143 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:53:51.179844 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:51.180068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.180714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:53:51.180714 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:51.180714 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:51.180714 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:51.180714 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:51.180714 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:51.180714 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.180714 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:51.181847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.181847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:51.181847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:51.181847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:51.181847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:51.181847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:51.181847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:51.181847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:51.181847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:51.181847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:51.181847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:51.181847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:51.181847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:51.181847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:51.181847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:51.182691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:51.182691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:51.182691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:51.182691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:51.182691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:51.182691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:51.182691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:51.182691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.182691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:51.183365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.183365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:51.183365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:51.183365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:51.183365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:51.183365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:51.183365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:51.183365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:51.183365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:51.183365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:51.183365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:51.183365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:51.183365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:51.183365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:53:51.183365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:53:51.183365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:51.184059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:51.185008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:51.185008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.185008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:51.381111 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:51.381483 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:51.382424 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:51.382865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.383785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:53:51.383785 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:51.383785 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:51.383785 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:51.383785 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:51.383785 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:51.383785 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.383785 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:51.384969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.384969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:51.384969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:51.384969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:51.384969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:51.384969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:51.384969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:51.384969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:51.384969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:51.384969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:51.384969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:51.384969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:51.384969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:51.384969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:51.384969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:51.384969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:51.385862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:51.385862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:51.385862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:51.385862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:51.385862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:51.385862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:51.385862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.385862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:51.386591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.386591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:51.386591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:51.386591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:51.386591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:51.386591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:51.386591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:51.386591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:51.386591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:51.386591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:51.386591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:51.386591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:51.386591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:51.386591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:53:51.386591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:53:51.386591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:51.387519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:51.388481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.388481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:51.444970 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:51.445383 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:51.445928 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:51.446245 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:51.446371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.447112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:53:51.447112 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:51.447112 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:51.447112 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:51.447112 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:51.447112 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:51.447112 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.447112 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:51.449334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.449334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:51.449334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:51.449334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:51.449334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:51.449334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:51.449334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:51.449334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:51.449334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:51.449334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:51.449334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:51.449334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:51.449334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:51.449334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:53:51.449334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:51.449334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:51.449334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:51.450243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:56.008115 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:56.009169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:56.048844 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:56.049080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.049836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:53:56.049836 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:56.049836 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:56.049836 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:56.049836 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:56.049836 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:56.049836 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.049836 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:56.050541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.050541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:56.050541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:56.050541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:56.050541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:56.050541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:56.050541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:56.050541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:56.050541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:56.050541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:56.050541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:56.050541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:56.050541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:56.050541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:53:56.050541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:56.050541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:56.050541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.051388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:56.062697 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:56.063497 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:56.063497 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:56.063949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.064292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:53:56.064292 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:56.064292 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:56.064292 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:56.064292 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:56.064292 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:56.064292 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.064292 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:56.065064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.065064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:56.065064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:56.065064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:56.065064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:56.065064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:56.065064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:56.065064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:56.065064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:56.065064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:56.065064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:56.065064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:56.065064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:56.065064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:53:56.065064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:56.065064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.065639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:56.181706 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:56.182309 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:53:56.183150 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:56.183150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.184240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:53:56.184240 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:56.184240 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:56.184240 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:56.184240 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:56.184240 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:56.184240 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.184240 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:56.185103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.185103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:56.185103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:56.185103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:56.185103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:56.185103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:56.185103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:56.185103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:56.185103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:56.185103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:56.185103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:56.185103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:56.185103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:56.185103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:56.185103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:56.185637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:56.185637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:56.185637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:56.185637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:56.185637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:56.185637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:56.185637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:56.185637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.185637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:56.186184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.186184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:56.186184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:56.186184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:56.186184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:56.186184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:56.186184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:56.186184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:56.186184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:56.186184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:56.186184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:56.186184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:56.186184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:56.186184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:53:56.186184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:53:56.186184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:56.186568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:56.186948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:56.186948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.186948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:56.381848 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:56.383145 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:56.383145 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:56.383301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.383866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:53:56.383866 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:56.383866 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:56.383866 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:56.383866 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:56.383866 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:56.383866 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.383866 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:56.384697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.384697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:53:56.384697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:56.384697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:56.384697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:56.384697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:56.384697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:56.384697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:56.384697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:56.384697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:53:56.384697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:56.384697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:53:56.384697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:56.384697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:53:56.384697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:53:56.384697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:56.385378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:53:56.385378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:56.385378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:53:56.385378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:53:56.385378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:56.385378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:53:56.385378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.385378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:53:56.385708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.385708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:56.385708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:56.385708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:56.385708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:56.385708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:56.385708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:56.385708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:56.385708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:56.385708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:56.385708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:56.385708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:56.385708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:56.385708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:53:56.385708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:53:56.385708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:56.386471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:56.387421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.387421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:53:56.445474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:53:56.446081 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:53:56.446521 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:56.446922 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:53:56.447170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.447947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:53:56.447947 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:56.447947 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:53:56.447947 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:53:56.447947 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:56.447947 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:53:56.447947 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.447947 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:53:56.449029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.449029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:53:56.449029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:53:56.449029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:53:56.449029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:53:56.449029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:53:56.449029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:56.449029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:53:56.449029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:53:56.449029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:53:56.449029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:53:56.449029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:53:56.449029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:53:56.449029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:53:56.449029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:53:56.449029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:56.449029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:53:56.449606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:01.008714 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:01.010267 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:01.047167 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:01.047342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.048339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:54:01.048339 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:01.048339 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:01.048339 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:01.048339 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:01.048339 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:01.048339 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.048339 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:01.049495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.049495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:01.049495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:01.049495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:01.049495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:01.049495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:01.049495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:01.049495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:01.049495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:01.049495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:01.049495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:01.049495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:01.049495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:01.049495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:54:01.049495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:01.049495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:01.049495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.050220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:01.063179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:01.064308 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:01.064625 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:01.064878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.065842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:54:01.065842 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:01.065842 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:01.065842 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:01.065842 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:01.065842 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:01.065842 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.065842 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:01.067266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.067266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:01.067266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:01.067266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:01.067266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:01.067266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:01.067266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:01.067266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:01.067266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:01.067266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:01.067266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:01.067266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:01.067266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:01.067266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:54:01.067266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:01.067266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.068038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:01.182346 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:01.183193 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:54:01.183977 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:01.184321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.185425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:54:01.185425 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:01.185425 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:01.185425 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:01.185425 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:01.185425 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:01.185425 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.185425 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:01.186637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.186637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:01.186637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:01.186637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:01.186637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:01.186637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:01.186637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:01.186637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:01.186637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:01.186637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:01.186637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:01.186637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:01.186637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:01.186637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:01.186637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:01.187391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:01.187391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:01.187391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:01.187391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:01.187391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:01.187391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:01.187391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:01.187391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.187391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:01.188075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.188075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:01.188075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:01.188075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:01.188075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:01.188075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:01.188075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:01.188075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:01.188075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:01.188075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:01.188075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:01.188075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:01.188075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:01.188075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:54:01.188075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:54:01.188075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:01.189060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:01.189846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:01.189846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.189846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:01.382456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:01.382874 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:01.384915 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:01.384915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.385130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:54:01.385130 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:01.385130 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:01.385130 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:01.385130 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:01.385130 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:01.385130 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.385130 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:01.386641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.386641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:01.386641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:01.386641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:01.386641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:01.386641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:01.386641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:01.386641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:01.386641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:01.386641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:01.386641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:01.386641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:01.386641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:01.386641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:01.386641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:01.386641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:01.387364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:01.387364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:01.387364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:01.387364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:01.387364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:01.387364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:01.387364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.387364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:01.388529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.388529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:01.388529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:01.388529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:01.388529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:01.388529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:01.388529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:01.388529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:01.388529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:01.388529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:01.388529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:01.388529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:01.388529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:01.388529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:54:01.388529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:54:01.388529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:01.389018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:01.389492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.389492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:01.446067 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:01.447784 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:01.448973 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:01.448973 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:01.448973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.449678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:54:01.449678 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:01.449678 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:01.449678 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:01.449678 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:01.449678 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:01.449678 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.449678 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:01.450885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.450885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:01.450885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:01.450885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:01.450885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:01.450885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:01.450885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:01.450885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:01.450885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:01.450885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:01.450885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:01.450885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:01.450885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:01.450885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:54:01.450885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:01.450885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:01.450885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:01.451699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:06.009382 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:06.010694 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:06.045979 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:06.046353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.047210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:54:06.047210 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:06.047210 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:06.047210 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:06.047210 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:06.047210 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:06.047210 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.047210 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:06.048429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.048429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:06.048429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:06.048429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:06.048429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:06.048429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:06.048429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:06.048429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:06.048429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:06.048429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:06.048429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:06.048429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:06.048429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:06.048429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:54:06.048429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:06.048429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:06.048429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.049205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:06.066855 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:06.068259 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:06.068768 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:06.069019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:06.071232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:06.071951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:06.072581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:06.072581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:06.072581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:06.072581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:06.072581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.072581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:06.182925 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:06.183168 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:54:06.183850 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:06.184206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.184957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:54:06.184957 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:06.184957 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:06.184957 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:06.184957 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:06.184957 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:06.184957 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.184957 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:06.185671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.185671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:06.185671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:06.185671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:06.185671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:06.185671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:06.185671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:06.185671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:06.185671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:06.185671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:06.185671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:06.185671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:06.185671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:06.185671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:06.185671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:06.185978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:06.185978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:06.185978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:06.185978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:06.185978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:06.185978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:06.185978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:06.185978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.185978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:06.186409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.186409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:06.186409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:06.186409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:06.186409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:06.186409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:06.186409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:06.186409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:06.186409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:06.186409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:06.186409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:06.186409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:06.186409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:06.186409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:54:06.186409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:54:06.186409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:06.186777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:06.187163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:06.187163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.187163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:06.383106 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:06.383531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:06.384513 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:06.384848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.386306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:54:06.386306 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:06.386306 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:06.386306 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:06.386306 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:06.386306 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:06.386306 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.386306 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:06.387925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.387925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:06.387925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:06.387925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:06.387925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:06.387925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:06.387925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:06.387925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:06.387925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:06.387925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:06.387925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:06.387925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:06.387925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:06.387925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:06.387925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:06.387925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:06.388865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:06.388865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:06.388865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:06.388865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:06.388865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:06.388865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:06.388865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.388865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:06.388865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.388865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:06.388865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:06.388865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:06.388865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:06.388865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:06.388865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:06.388865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:06.389653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:06.391386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:06.391386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:06.391386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:06.391386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:06.391386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:06.391386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:06.391386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:06.391386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.391386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:06.447813 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:06.448457 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:06.451315 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:06.451315 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:06.451315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.451500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:54:06.451500 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:06.451500 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:06.451500 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:06.451500 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:06.451500 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:06.451500 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.451500 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:06.452641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.452641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:06.452641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:06.452641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:06.452641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:06.452641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:06.452641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:06.452641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:06.452641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:06.452641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:06.452641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:06.452641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:06.452641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:06.452641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:54:06.452641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:06.452641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:06.452641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:06.453343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:11.010085 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:11.011827 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:11.052233 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:11.053100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.053569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:54:11.053569 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:11.053569 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:11.053569 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:11.053569 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:11.053569 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:11.053569 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.053569 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:11.056177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.056177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:11.056177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:11.056177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:11.056177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:11.056177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:11.056177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:11.056177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:11.056177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:11.056177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:11.056177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:11.056177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:11.056177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:11.056177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:54:11.056177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:11.056177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:11.056177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.056978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:11.067552 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:11.068795 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:11.069931 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:11.069931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.070894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:54:11.070894 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:11.070894 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:11.070894 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:11.070894 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:11.070894 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:11.070894 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.070894 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:11.072950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.072950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:11.072950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:11.072950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:11.072950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:11.072950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:11.072950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:11.072950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:11.072950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:11.072950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:11.072950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:11.072950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:11.072950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:11.072950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:54:11.072950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:11.072950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.073901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:11.183412 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:11.183953 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:54:11.184509 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:11.184784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.185577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:54:11.185577 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:11.185577 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:11.185577 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:11.185577 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:11.185577 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:11.185577 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.185577 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:11.186840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.186840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:11.186840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:11.186840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:11.186840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:11.186840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:11.186840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:11.186840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:11.186840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:11.186840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:11.186840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:11.186840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:11.186840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:11.186840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:11.186840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:11.187293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:11.187293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:11.187293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:11.187293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:11.187293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:11.187293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:11.187293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:11.187293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.187293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:11.188458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.188458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:11.188458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:11.188458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:11.188458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:11.188458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:11.188458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:11.188458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:11.188458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:11.188458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:11.188458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:11.188458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:11.188458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:11.188458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:54:11.188458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:54:11.188458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:11.188896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:11.189376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:11.189376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.189376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:11.383683 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:11.384063 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:11.384490 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:11.384753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.385945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:54:11.385945 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:11.385945 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:11.385945 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:11.385945 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:11.385945 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:11.385945 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.385945 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:11.386762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.386762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:11.386762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:11.386762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:11.386762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:11.386762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:11.386762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:11.386762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:11.386762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:11.386762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:11.386762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:11.386762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:11.386762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:11.386762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:11.386762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:11.386762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:11.387280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:11.387280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:11.387280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:11.387280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:11.387280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:11.387280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:11.387280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.387280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:11.387535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.387535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:11.387535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:11.387535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:11.387535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:11.387535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:11.387535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:11.387535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:11.387535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:11.387535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:11.387535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:11.387535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:11.387535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:11.387535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:54:11.387535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:54:11.387535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:11.388013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:11.388543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.388543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:11.448813 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:11.449105 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:11.449676 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:11.450142 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:11.450506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.451309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:54:11.451309 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:11.451309 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:11.451309 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:11.451309 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:11.451309 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:11.451309 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.451309 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:11.452035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.452035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:11.452035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:11.452035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:11.452035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:11.452035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:11.452035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:11.452035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:11.452035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:11.452035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:11.452035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:11.452035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:11.452035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:11.452035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:54:11.452035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:11.452035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:11.452035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:11.452611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:16.010738 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:16.012119 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:16.051460 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:16.051690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.052382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:54:16.052382 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:16.052382 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:16.052382 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:16.052382 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:16.052382 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:16.052382 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.052382 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:16.053538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.053538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:16.053538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:16.053538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:16.053538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:16.053538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:16.053538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:16.053538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:16.053538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:16.053538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:16.053538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:16.053538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:16.053538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:16.053538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:54:16.053538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:16.053538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:16.053538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.053906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:16.068159 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:16.068965 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:16.069180 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:16.069579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.070406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:54:16.070406 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:16.070406 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:16.070406 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:16.070406 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:16.070406 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:16.070406 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.070406 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:16.071507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.071507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:16.071507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:16.071507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:16.071507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:16.071507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:16.071507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:16.071507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:16.071507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:16.071507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:16.071507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:16.071507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:16.071507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:16.071507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:54:16.071507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:16.071507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.071904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:16.184064 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:16.184612 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:54:16.185026 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:16.185199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.185758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:54:16.185758 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:16.185758 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:16.185758 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:16.185758 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:16.185758 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:16.185758 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.185758 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:16.186999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.186999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:16.186999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:16.186999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:16.186999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:16.186999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:16.186999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:16.186999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:16.186999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:16.186999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:16.186999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:16.186999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:16.186999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:16.186999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:16.186999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:16.187672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:16.187672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:16.187672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:16.187672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:16.187672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:16.187672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:16.187672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:16.187672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.187672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:16.188602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.188602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:16.188602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:16.188602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:16.188602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:16.188602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:16.188602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:16.188602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:16.188602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:16.188602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:16.188602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:16.188602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:16.188602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:16.188602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:54:16.188602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:54:16.188602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:16.189159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:16.189804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:16.189804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.189804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:16.384297 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:16.384761 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:16.385301 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:16.386116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.386116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:54:16.386116 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:16.386116 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:16.386116 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:16.386116 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:16.386116 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:16.386116 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.386116 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:16.386870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.386870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:16.386870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:16.386870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:16.386870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:16.386870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:16.386870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:16.386870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:16.386870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:16.386870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:16.386870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:16.386870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:16.386870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:16.386870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:16.386870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:16.386870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:16.387505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:16.387505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:16.387505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:16.387505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:16.387505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:16.387505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:16.387505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.387505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:16.388001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.388001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:16.388001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:16.388001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:16.388001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:16.388001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:16.388001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:16.388001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:16.388001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:16.388001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:16.388001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:16.388001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:16.388001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:16.388001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:54:16.388001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:54:16.388001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:16.388652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:16.389329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.389329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:16.449207 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:16.450044 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:16.450798 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:16.450798 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:16.451197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.452049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:54:16.452049 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:16.452049 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:16.452049 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:16.452049 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:16.452049 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:16.452049 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.452049 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:16.454106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.454106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:16.454106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:16.454106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:16.454106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:16.454106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:16.454106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:16.454106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:16.454106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:16.454106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:16.454106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:16.454106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:16.454106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:16.454106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:54:16.454106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:16.454106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:16.454106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:16.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:21.011456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:21.012599 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:21.023682 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=240 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:54:21.045956 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:21.046287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.047095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:54:21.047095 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:21.047095 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:21.047095 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:21.047095 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:21.047095 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:21.047095 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.047095 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:21.048231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.048231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:21.048231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:21.048231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:21.048231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:21.048231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:21.048231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:21.048231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:21.048231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:21.048231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:21.048231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:21.048231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:21.048231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:21.048231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:54:21.048231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:21.048231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:21.048231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.048814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:21.068879 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:21.070140 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:21.070502 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:21.070502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.071356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:54:21.071356 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:21.071356 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:21.071356 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:21.071356 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:21.071356 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:21.071356 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.071356 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:21.072913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.072913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:21.072913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:21.072913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:21.072913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:21.072913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:21.072913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:21.072913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:21.072913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:21.072913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:21.072913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:21.072913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:21.072913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:21.072913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:54:21.072913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:21.072913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.073569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:21.184686 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:21.185158 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:54:21.185898 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:21.186142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.186832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:54:21.186832 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:21.186832 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:21.186832 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:21.186832 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:21.186832 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:21.186832 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.186832 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:21.188569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.188569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:21.188569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:21.188569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:21.188569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:21.188569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:21.188569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:21.188569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:21.188569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:21.188569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:21.188569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:21.188569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:21.188569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:21.188569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:21.188569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:21.189167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:21.189167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:21.189167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:21.189167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:21.189167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:21.189167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:21.189167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:21.189167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.189167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:21.190393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.190393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:21.190393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:21.190393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:21.190393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:21.190393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:21.190393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:21.190393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:21.190393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:21.190393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:21.190393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:21.190393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:21.190393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:21.190393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:54:21.190393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:54:21.190393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:21.191070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:21.191765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:21.191765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.191765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:21.385237 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:21.385672 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:21.386498 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:21.386920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.387795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:54:21.387795 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:21.387795 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:21.387795 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:21.387795 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:21.387795 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:21.387795 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.387795 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:21.389255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.389255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:21.389255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:21.389255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:21.389255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:21.389255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:21.389255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:21.389255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:21.389255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:21.389255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:21.389255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:21.389255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:21.389255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:21.389255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:21.389255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:21.389255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:21.390021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:21.390021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:21.390021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:21.390021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:21.390021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:21.390021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:21.390021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.390021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:21.390892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.390892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:21.390892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:21.390892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:21.390892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:21.390892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:21.390892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:21.390892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:21.390892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:21.390892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:21.390892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:21.390892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:21.390892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:21.390892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:54:21.390892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:54:21.390892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:21.391395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:21.391884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.391884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:21.449667 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:21.450285 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:21.450706 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:21.451450 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:21.451450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:21.453457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:21.454333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:21.455021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:21.455021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:21.455021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:21.455021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:21.455021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:21.455021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:26.012111 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:26.016582 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:26.051374 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:26.051595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.052219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:54:26.052219 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:26.052219 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:26.052219 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:26.052219 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:26.052219 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:26.052219 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.052219 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:26.053127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.053127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:26.053127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:26.053127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:26.053127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:26.053127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:26.053127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:26.053127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:26.053127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:26.053127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:26.053127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:26.053127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:26.053127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:26.053127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:54:26.053127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:26.053127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:26.053127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.053677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:26.069623 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:26.071524 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:26.071524 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:26.071524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.071788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:54:26.071788 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:26.071788 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:26.071788 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:26.071788 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:26.071788 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:26.071788 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.071788 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:26.073368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.073368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:26.073368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:26.073368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:26.073368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:26.073368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:26.073368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:26.073368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:26.073368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:26.073368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:26.073368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:26.073368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:26.073368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:26.073368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:54:26.073368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:26.073368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.073853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:26.185247 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:26.185566 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:54:26.187204 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:26.187204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.187802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:54:26.187802 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:26.187802 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:26.187802 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:26.187802 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:26.187802 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:26.187802 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.187802 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:26.189438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.189438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:26.189438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:26.189438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:26.189438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:26.189438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:26.189438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:26.189438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:26.189438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:26.189438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:26.189438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:26.189438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:26.189438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:26.189438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:26.189438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:26.191271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:26.191271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:26.191271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:26.191271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:26.191271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:26.191271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:26.191271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:26.191271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.191271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:26.192041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.192041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:26.192041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:26.192041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:26.192041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:26.192041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:26.192041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:26.192041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:26.192041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:26.192041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:26.192041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:26.192041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:26.192041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:26.192041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:54:26.192041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:54:26.192041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:26.192886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:26.194173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:26.194173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.194173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:26.385821 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:26.386809 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:26.391661 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:26.391661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.391661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:54:26.391661 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:26.391661 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:26.391661 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:26.391661 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:26.391661 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:26.391661 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.391661 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:26.391661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.391661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:26.391661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:26.391661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:26.391661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:26.391661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:26.392444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:26.392444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:26.392444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:26.392444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:26.392444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:26.392444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:26.392444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:26.392444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:26.392444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:26.392444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:26.392444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:26.392444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:26.392444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:26.392444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:26.392444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:26.392444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:26.393007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.393007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:26.393007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.393007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:26.393007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:26.393007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:26.393007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:26.393007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:26.393007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:26.393007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:26.393007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:26.393007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:26.393007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:26.393007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:26.393007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:26.393007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:26.393623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:26.394374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:26.394374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:26.394374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.394374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:26.450601 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:26.451241 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:26.451884 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:26.452320 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:26.452459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.453317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:54:26.453317 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:26.453317 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:26.453317 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:26.453317 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:26.453317 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:26.453317 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.453317 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:26.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:26.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:26.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:26.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:26.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:26.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:26.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:26.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:26.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:26.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:26.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:26.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:26.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:54:26.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:26.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:26.454766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:26.455584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:31.014385 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:31.015561 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:31.066420 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:31.066907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.068114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:54:31.068114 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:31.068114 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:31.068114 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:31.068114 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:31.068114 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:31.068114 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.068114 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:31.069795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.069795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:31.069795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:31.069795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:31.069795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:31.069795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:31.069795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:31.069795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:31.069795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:31.069795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:31.069795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:31.069795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:31.069795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:31.069795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:54:31.069795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:31.069795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:31.069795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.070359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:31.070883 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:31.071030 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:31.071243 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:31.071391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.071970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:54:31.071970 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:31.071970 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:31.071970 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:31.071970 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:31.071970 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:31.071970 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.071970 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:31.073322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.073322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:31.073322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:31.073322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:31.073322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:31.073322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:31.073322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:31.073322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:31.073322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:31.073322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:31.073322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:31.073322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:31.073322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:31.073322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:54:31.073322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:31.073322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.073904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:31.185757 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:31.186245 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:54:31.186947 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:31.187288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.188145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:54:31.188145 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:31.188145 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:31.188145 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:31.188145 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:31.188145 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:31.188145 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.188145 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:31.189391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.189391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:31.189391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:31.189391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:31.189391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:31.189391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:31.189391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:31.189391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:31.189391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:31.189391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:31.189391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:31.189391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:31.189391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:31.189391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:31.189391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:31.190469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:31.190469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:31.190469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:31.190469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:31.190469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:31.190469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:31.190469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:31.190469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.190469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:31.190914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.190914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:31.190914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:31.190914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:31.190914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:31.190914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:31.190914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:31.190914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:31.190914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:31.190914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:31.190914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:31.190914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:31.190914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:31.190914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:54:31.190914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:54:31.190914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:31.191797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:31.192685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:31.192685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.192685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:31.387358 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:31.388188 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:31.388895 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:31.389290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.390928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:54:31.390928 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:31.390928 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:31.390928 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:31.390928 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:31.390928 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:31.390928 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.390928 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:31.391544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.391544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:31.391544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:31.391544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:31.391544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:31.391544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:31.391544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:31.391544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:31.391544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:31.391544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:31.391544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:31.391544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:31.391544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:31.391544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:31.391544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:31.391544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:31.392125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:31.392125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:31.392125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:31.392125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:31.392125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:31.392125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:31.392125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.392125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:31.392688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.392688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:31.392688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:31.392688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:31.392688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:31.392688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:31.392688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:31.392688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:31.392688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:31.392688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:31.392688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:31.392688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:31.392688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:31.392688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:54:31.392688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:54:31.392688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:31.393452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:31.394329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.394329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:31.451264 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:31.451670 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:31.452015 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:31.452293 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:31.452440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.453416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:54:31.453416 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:31.453416 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:31.453416 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:31.453416 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:31.453416 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:31.453416 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.453416 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:31.454542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.454542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:31.454542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:31.454542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:31.454542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:31.454542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:31.454542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:31.454542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:31.454542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:31.454542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:31.454542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:31.454542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:31.454542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:31.454542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:54:31.454542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:31.454542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:31.454542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:31.455132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:36.014911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:36.016681 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:36.057141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:36.057736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.058277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:54:36.058277 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:36.058277 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:36.058277 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:36.058277 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:36.058277 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:36.058277 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.058277 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:36.059897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.059897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:36.059897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:36.059897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:36.059897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:36.059897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:36.059897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:36.059897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:36.059897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:36.059897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:36.059897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:36.059897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:36.059897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:36.059897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:54:36.059897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:36.059897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:36.059897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.060437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:36.070730 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:36.071890 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:36.072243 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:36.072483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.073466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:54:36.073466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:36.073466 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:36.073466 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:36.073466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:36.073466 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:36.073466 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.073466 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:36.074435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.074435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:36.074435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:36.074435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:36.074435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:36.074435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:36.074435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:36.074435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:36.074435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:36.074435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:36.074435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:36.074435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:36.074435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:36.074435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:54:36.074435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:36.074435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.074791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:36.186637 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:36.187574 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:54:36.187873 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:36.188183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.189045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:54:36.189045 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:36.189045 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:36.189045 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:36.189045 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:36.189045 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:36.189045 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.189045 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:36.189770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.189770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:36.189770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:36.189770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:36.189770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:36.189770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:36.189770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:36.189770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:36.189770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:36.189770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:36.189770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:36.189770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:36.189770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:36.189770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:36.189770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:36.190143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:36.190143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:36.190143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:36.190143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:36.190143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:36.190143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:36.190143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:36.190143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.190143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:36.190759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.190759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:36.190759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:36.190759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:36.190759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:36.190759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:36.190759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:36.190759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:36.190759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:36.190759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:36.190759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:36.190759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:36.190759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:36.190759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:54:36.190759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:54:36.190759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:36.191279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:36.191815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:36.191815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.191815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:36.388062 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:36.388230 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:36.388879 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:36.389751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.390009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:54:36.390009 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:36.390009 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:36.390009 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:36.390009 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:36.390009 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:36.390009 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.390009 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:36.390815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.390815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:36.390815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:36.390815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:36.390815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:36.390815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:36.390815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:36.390815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:36.390815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:36.390815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:36.390815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:36.390815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:36.390815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:36.390815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:36.390815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:36.390815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:36.391643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:36.391643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:36.391643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:36.391643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:36.391643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:36.391643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:36.391643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.391643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:36.391967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.391967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:36.391967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:36.391967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:36.391967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:36.391967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:36.391967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:36.391967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:36.391967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:36.391967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:36.391967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:36.391967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:36.391967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:36.391967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:54:36.391967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:54:36.391967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:36.392597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:36.393321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.393321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:36.453037 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:36.453969 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:36.454223 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:36.454340 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:36.454448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.454948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Traceback (most recent call last):
Apr 07 19:54:36.454948 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:36.454948 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:36.454948 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:36.454948 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:36.454948 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:36.454948 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.454948 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:36.455785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee61d89a-4bc6-425f-ac66-4032d7bf709f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.455785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:36.455785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:36.455785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:36.455785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:36.455785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:36.455785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:36.455785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:36.455785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:36.455785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:36.455785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:36.455785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:36.455785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:36.455785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:54:36.455785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:36.455785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:36.455785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:36.456698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:41.015585 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:41.017940 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:41.054831 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:41.055151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.055826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:54:41.055826 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:41.055826 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:41.055826 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:41.055826 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:41.055826 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:41.055826 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.055826 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:41.056966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.056966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:41.056966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:41.056966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:41.056966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:41.056966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:41.056966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:41.056966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:41.056966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:41.056966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:41.056966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:41.056966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:41.056966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:41.056966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:54:41.056966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:41.056966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:41.056966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.057606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:41.071398 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:41.072518 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:41.072864 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:41.073161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.073886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:54:41.073886 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:41.073886 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:41.073886 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:41.073886 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:41.073886 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:41.073886 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.073886 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:41.074778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.074778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:41.074778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:41.074778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:41.074778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:41.074778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:41.074778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:41.074778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:41.074778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:41.074778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:41.074778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:41.074778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:41.074778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:41.074778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:54:41.074778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:41.074778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.075362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:41.187527 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:41.188625 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:54:41.189469 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:41.189726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.190704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:54:41.190704 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:41.190704 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:41.190704 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:41.190704 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:41.190704 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:41.190704 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.190704 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:41.192244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.192244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:41.192244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:41.192244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:41.192244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:41.192244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:41.192244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:41.192244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:41.192244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:41.192244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:41.192244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:41.192244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:41.192244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:41.192244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:41.192244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:41.193052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:41.193052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:41.193052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:41.193052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:41.193052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:41.193052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:41.193052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:41.193052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.193052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:41.194899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.194899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:41.194899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:41.194899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:41.194899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:41.194899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:41.194899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:41.194899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:41.194899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:41.194899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:41.194899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:41.194899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:41.194899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:41.194899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:54:41.194899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:54:41.194899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:41.195697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:41.196541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:41.196541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.196541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:41.388695 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:41.389063 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:41.389548 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:41.389822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.390475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:54:41.390475 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:41.390475 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:41.390475 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:41.390475 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:41.390475 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:41.390475 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.390475 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:41.391525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.391525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:41.391525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:41.391525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:41.391525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:41.391525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:41.391525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:41.391525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:41.391525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:41.391525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:41.391525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:41.391525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:41.391525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:41.391525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:41.391525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:41.391525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:41.392443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:41.392443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:41.392443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:41.392443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:41.392443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:41.392443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:41.392443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.392443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:41.393069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.393069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:41.393069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:41.393069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:41.393069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:41.393069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:41.393069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:41.393069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:41.393069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:41.393069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:41.393069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:41.393069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:41.393069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:41.393069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:54:41.393069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:54:41.393069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:41.393876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:41.394800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.394800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:41.453819 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:41.454221 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:41.454831 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:41.454917 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:41.455028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.455589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:54:41.455589 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:41.455589 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:41.455589 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:41.455589 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:41.455589 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:41.455589 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.455589 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:41.456642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.456642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:41.456642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:41.456642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:41.456642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:41.456642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:41.456642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:41.456642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:41.456642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:41.456642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:41.456642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:41.456642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:41.456642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:41.456642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:54:41.456642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:41.456642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:41.456642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:41.457364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:46.016888 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:46.019614 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:46.058119 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:46.059810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.059810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:54:46.059810 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:46.059810 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:46.059810 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:46.059810 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:46.059810 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:46.059810 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.059810 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:46.060193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.060193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:46.060193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:46.060193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:46.060193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:46.060193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:46.060193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:46.060193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:46.060193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:46.060193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:46.060193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:46.060193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:46.060193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:46.060193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:54:46.060193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:46.060193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:46.060193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.060683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:46.071895 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:46.073403 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:46.073498 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:46.073695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.074716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:54:46.074716 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:46.074716 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:46.074716 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:46.074716 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:46.074716 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:46.074716 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.074716 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:46.076573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.076573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:46.076573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:46.076573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:46.076573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:46.076573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:46.076573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:46.076573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:46.076573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:46.076573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:46.076573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:46.076573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:46.076573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:46.076573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:54:46.076573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:46.076573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.077111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:46.188444 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:46.189160 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:54:46.190606 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:46.190897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.191898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:54:46.191898 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:46.191898 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:46.191898 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:46.191898 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:46.191898 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:46.191898 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.191898 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:46.193174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.193174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:46.193174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:46.193174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:46.193174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:46.193174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:46.193174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:46.193174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:46.193174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:46.193174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:46.193174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:46.193174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:46.193174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:46.193174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:46.193174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:46.193673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:46.193673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:46.193673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:46.193673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:46.193673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:46.193673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:46.193673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:46.193673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.193673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:46.194896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.194896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:46.194896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:46.194896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:46.194896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:46.194896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:46.194896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:46.194896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:46.194896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:46.194896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:46.194896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:46.194896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:46.194896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:46.194896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:54:46.194896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:54:46.194896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:46.195378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:46.195826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:46.195826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.195826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:46.389471 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:46.390114 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:46.390510 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:46.390845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.391533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:54:46.391533 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:46.391533 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:46.391533 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:46.391533 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:46.391533 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:46.391533 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.391533 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:46.392247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.392247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:46.392247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:46.392247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:46.392247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:46.392247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:46.392247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:46.392247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:46.392247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:46.392247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:46.392247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:46.392247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:46.392247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:46.392247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:46.392247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:46.392247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:46.392888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:46.392888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:46.392888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:46.392888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:46.392888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:46.392888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:46.392888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.392888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:46.393365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.393365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:46.393365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:46.393365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:46.393365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:46.393365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:46.393365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:46.393365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:46.393365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:46.393365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:46.393365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:46.393365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:46.393365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:46.393365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:54:46.393365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:54:46.393365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:46.393921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:46.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:46.454375 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:46.454938 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:46.455602 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:46.455867 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:46.456163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.456818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:54:46.456818 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:46.456818 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:46.456818 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:46.456818 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:46.456818 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:46.456818 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.456818 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:46.458897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.458897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:46.458897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:46.458897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:46.458897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:46.458897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:46.458897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:46.458897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:46.458897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:46.458897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:46.458897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:46.458897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:46.458897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:46.458897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:54:46.458897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:46.458897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:46.458897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:46.459438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:51.017705 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:51.019335 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:51.058420 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:51.058638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.059179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:54:51.059179 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:51.059179 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:51.059179 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:51.059179 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:51.059179 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:51.059179 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.059179 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:51.060056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.060056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:51.060056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:51.060056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:51.060056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:51.060056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:51.060056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:51.060056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:51.060056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:51.060056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:51.060056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:51.060056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:51.060056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:51.060056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:54:51.060056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:51.060056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:51.060056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.061143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:51.072569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:51.073671 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:51.073939 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:51.074205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.078153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:54:51.078153 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:51.078153 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:51.078153 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:51.078153 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:51.078153 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:51.078153 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.078153 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:51.079839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.079839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:51.079839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:51.079839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:51.079839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:51.079839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:51.079839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:51.079839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:51.079839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:51.079839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:51.079839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:51.079839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:51.079839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:51.079839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:54:51.079839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:51.079839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.080799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:51.189025 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:51.189722 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:54:51.190326 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:51.190496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.191051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:54:51.191051 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:51.191051 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:51.191051 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:51.191051 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:51.191051 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:51.191051 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.191051 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:51.191716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.191716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:51.191716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:51.191716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:51.191716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:51.191716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:51.191716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:51.191716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:51.191716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:51.191716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:51.191716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:51.191716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:51.191716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:51.191716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:51.191716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:51.192301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:51.192301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:51.192301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:51.192301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:51.192301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:51.192301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:51.192301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:51.192301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.192301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:51.192619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.192619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:51.192619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:51.192619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:51.192619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:51.192619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:51.192619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:51.192619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:51.192619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:51.192619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:51.192619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:51.192619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:51.192619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:51.192619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:54:51.192619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:54:51.192619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:51.193159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:51.193836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:51.193836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.193836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:51.390220 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:51.390435 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:51.391176 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:51.391575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.392289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:54:51.392289 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:51.392289 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:51.392289 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:51.392289 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:51.392289 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:51.392289 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.392289 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:51.392909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.392909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:51.392909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:51.392909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:51.392909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:51.392909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:51.392909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:51.392909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:51.392909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:51.392909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:51.392909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:51.392909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:51.392909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:51.392909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:51.392909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:51.392909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:51.393705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:51.393705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:51.393705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:51.393705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:51.393705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:51.393705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:51.393705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.393705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:51.393705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.393705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:51.393705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:51.393705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:51.393705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:51.393705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:51.393705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:51.393705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:51.394268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:51.395048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:51.395048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:51.395048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:51.395048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:51.395048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:51.395048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:51.395048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:51.395048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.395048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:51.454973 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:51.455786 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:51.456276 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:51.456492 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:51.456627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:51.458557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:51.459274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:51.459810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:51.459810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:51.459810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:51.459810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:56.018371 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:56.019312 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:56.045405 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:56.045939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.046591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:54:56.046591 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:56.046591 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:56.046591 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:56.046591 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:56.046591 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:56.046591 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.046591 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:56.047479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.047479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:56.047479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:56.047479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:56.047479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:56.047479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:56.047479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:56.047479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:56.047479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:56.047479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:56.047479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:56.047479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:56.047479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:56.047479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:54:56.047479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:56.047479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:56.047479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.048417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:56.073362 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:56.074189 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:56.074566 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:56.074726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.075638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:54:56.075638 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:56.075638 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:56.075638 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:56.075638 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:56.075638 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:56.075638 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.075638 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:56.079028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.079028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:56.079028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:56.079028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:56.079028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:56.079028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:56.079028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:56.079028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:56.079028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:56.079028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:56.079028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:56.079028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:56.079028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:56.079028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:54:56.079028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:56.079028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.079547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:56.189567 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:56.190426 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:54:56.190737 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:56.190967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.191774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:54:56.191774 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:56.191774 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:56.191774 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:56.191774 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:56.191774 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:56.191774 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.191774 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:56.193332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.193332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:56.193332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:56.193332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:56.193332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:56.193332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:56.193332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:56.193332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:56.193332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:56.193332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:56.193332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:56.193332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:56.193332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:56.193332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:56.193332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:56.193829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:56.193829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:56.193829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:56.193829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:56.193829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:56.193829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:56.193829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:56.193829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.193829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:56.195135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.195135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:56.195135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:56.195135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:56.195135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:56.195135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:56.195135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:56.195135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:56.195135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:56.195135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:56.195135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:56.195135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:56.195135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:56.195135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:54:56.195135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:54:56.195135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:56.195679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:56.196204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:56.196204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.196204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:56.390703 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:56.391093 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:56.391729 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:56.392113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.392741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:54:56.392741 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:56.392741 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:56.392741 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:56.392741 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:56.392741 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:56.392741 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.392741 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:56.393401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.393401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:54:56.393401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:56.393401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:56.393401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:56.393401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:56.393401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:56.393401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:56.393401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:56.393401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:54:56.393401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:56.393401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:54:56.393401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:56.393401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:54:56.393401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:54:56.393401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:56.393721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:54:56.393721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:56.393721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:54:56.393721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:54:56.393721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:56.393721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:54:56.393721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.393721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:54:56.394335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.394335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:56.394335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:56.394335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:56.394335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:56.394335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:56.394335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:56.394335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:56.394335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:56.394335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:56.394335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:56.394335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:56.394335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:56.394335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:54:56.394335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:54:56.394335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:56.394671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:56.395044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.395044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:54:56.456058 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:54:56.456058 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:54:56.457341 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:56.457592 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:54:56.457746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:54:56.459630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:54:56.460275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:54:56.461206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:54:56.461206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:54:56.461206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:54:56.461206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:01.019092 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:01.021612 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:01.054134 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:01.054443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.055252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:55:01.055252 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:01.055252 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:01.055252 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:01.055252 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:01.055252 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:01.055252 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.055252 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:01.056376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.056376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:01.056376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:01.056376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:01.056376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:01.056376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:01.056376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:01.056376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:01.056376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:01.056376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:01.056376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:01.056376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:01.056376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:01.056376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:55:01.056376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:01.056376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:01.056376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.057044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:01.074071 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:01.075364 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:01.075674 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:01.075903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.076875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:55:01.076875 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:01.076875 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:01.076875 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:01.076875 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:01.076875 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:01.076875 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.076875 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:01.078831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.078831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:01.078831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:01.078831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:01.078831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:01.078831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:01.078831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:01.078831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:01.078831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:01.078831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:01.078831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:01.078831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:01.078831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:01.078831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:55:01.078831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:01.078831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.079346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:01.190070 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:01.190786 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:55:01.191774 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:01.191930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:01.193733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:01.194246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:01.194246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:01.194246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:01.194246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:01.194246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:01.194246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:01.194246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:01.194246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:01.194246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:01.194246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:01.194246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:01.194246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:01.194246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.194246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:01.194510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.194510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:01.194510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:01.194510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:01.194510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:01.194510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:01.194510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:01.194510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:01.194510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:01.194510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:01.194510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:01.194510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:01.194510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:01.194510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:55:01.194510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:55:01.194510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:01.194822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:01.195168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:01.195168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.195168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:01.391382 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:01.391755 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:01.392291 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:01.392491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.393159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:01.393159 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:01.393159 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:01.393159 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:01.393159 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:01.393159 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:01.393159 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.393159 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:01.394562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.394562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:01.394562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:01.394562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:01.394562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:01.394562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:01.394562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:01.394562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:01.394562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:01.394562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:01.394562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:01.394562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:01.394562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:01.394562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:01.394562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:01.394562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:01.394964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:01.394964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:01.394964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:01.394964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:01.394964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:01.394964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:01.394964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.394964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:01.396661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.396661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:01.396661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:01.396661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:01.396661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:01.396661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:01.396661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:01.396661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:01.396661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:01.396661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:01.396661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:01.396661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:01.396661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:01.396661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:55:01.396661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:55:01.396661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:01.397064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:01.397393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.397393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:01.456199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:01.456576 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:01.456975 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:01.457674 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:01.457674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.458297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:01.458297 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:01.458297 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:01.458297 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:01.458297 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:01.458297 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:01.458297 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.458297 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:01.459162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.459162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:01.459162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:01.459162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:01.459162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:01.459162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:01.459162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:01.459162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:01.459162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:01.459162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:01.459162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:01.459162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:01.459162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:01.459162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:55:01.459162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:01.459162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:01.459162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:01.460905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:06.020626 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:06.021542 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:06.061347 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:06.061728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.062787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:55:06.062787 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:06.062787 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:06.062787 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:06.062787 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:06.062787 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:06.062787 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.062787 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:06.064449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.064449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:06.064449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:06.064449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:06.064449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:06.064449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:06.064449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:06.064449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:06.064449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:06.064449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:06.064449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:06.064449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:06.064449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:06.064449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:55:06.064449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:06.064449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:06.064449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.065027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:06.074861 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:06.075837 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:06.076179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:06.076503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.077439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:55:06.077439 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:06.077439 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:06.077439 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:06.077439 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:06.077439 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:06.077439 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.077439 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:06.078335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.078335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:06.078335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:06.078335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:06.078335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:06.078335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:06.078335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:06.078335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:06.078335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:06.078335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:06.078335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:06.078335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:06.078335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:06.078335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:55:06.078335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:06.078335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.079122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:06.191019 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:06.192492 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:55:06.193104 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:06.193404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.194143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:55:06.194143 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:06.194143 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:06.194143 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:06.194143 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:06.194143 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:06.194143 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.194143 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:06.194886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.194886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:06.194886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:06.194886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:06.194886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:06.194886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:06.194886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:06.194886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:06.194886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:06.194886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:06.194886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:06.194886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:06.194886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:06.194886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:06.194886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:06.195404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:06.195404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:06.195404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:06.195404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:06.195404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:06.195404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:06.195404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:06.195404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.195404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:06.195681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.195681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:06.195681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:06.195681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:06.195681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:06.195681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:06.195681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:06.195681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:06.195681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:06.195681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:06.195681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:06.195681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:06.195681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:06.195681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:55:06.195681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:55:06.195681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:06.196433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:06.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:06.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.197194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:06.392080 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:06.392345 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:06.392784 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:06.393222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.394083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:06.394083 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:06.394083 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:06.394083 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:06.394083 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:06.394083 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:06.394083 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.394083 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:06.395329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.395329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:06.395329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:06.395329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:06.395329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:06.395329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:06.395329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:06.395329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:06.395329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:06.395329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:06.395329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:06.395329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:06.395329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:06.395329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:06.395329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:06.395329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:06.396202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:06.396202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:06.396202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:06.396202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:06.396202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:06.396202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:06.396202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.396202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:06.396677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.396677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:06.396677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:06.396677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:06.396677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:06.396677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:06.396677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:06.396677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:06.396677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:06.396677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:06.396677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:06.396677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:06.396677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:06.396677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:55:06.396677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:55:06.396677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:06.397160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:06.397513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.397513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:06.456670 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:06.456998 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:06.457403 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:06.457818 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:06.457936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.458819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:06.458819 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:06.458819 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:06.458819 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:06.458819 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:06.458819 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:06.458819 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.458819 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:06.460378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.460378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:06.460378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:06.460378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:06.460378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:06.460378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:06.460378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:06.460378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:06.460378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:06.460378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:06.460378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:06.460378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:06.460378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:06.460378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:55:06.460378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:06.460378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:06.460378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:06.461330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:11.021291 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:11.023554 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:11.071635 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:11.071913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.072848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:55:11.072848 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:11.072848 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:11.072848 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:11.072848 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:11.072848 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:11.072848 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.072848 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:11.074437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.074437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:11.074437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:11.074437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:11.074437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:11.074437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:11.074437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:11.074437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:11.074437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:11.074437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:11.074437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:11.074437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:11.074437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:11.074437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:55:11.074437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:11.074437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:11.074437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.074922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:11.075365 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:11.076120 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:11.076492 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:11.076716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.078218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:55:11.078218 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:11.078218 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:11.078218 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:11.078218 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:11.078218 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:11.078218 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.078218 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:11.080002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.080002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:11.080002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:11.080002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:11.080002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:11.080002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:11.080002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:11.080002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:11.080002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:11.080002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:11.080002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:11.080002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:11.080002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:11.080002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:55:11.080002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:11.080002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.080863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:11.192698 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:11.193264 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:55:11.193872 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:11.194091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.194815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:55:11.194815 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:11.194815 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:11.194815 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:11.194815 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:11.194815 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:11.194815 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.194815 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:11.195796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.195796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:11.195796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:11.195796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:11.195796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:11.195796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:11.195796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:11.195796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:11.195796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:11.195796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:11.195796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:11.195796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:11.195796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:11.195796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:11.195796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:11.196159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:11.196159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:11.196159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:11.196159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:11.196159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:11.196159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:11.196159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:11.196159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.196159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:11.197095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.197095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:11.197095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:11.197095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:11.197095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:11.197095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:11.197095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:11.197095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:11.197095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:11.197095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:11.197095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:11.197095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:11.197095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:11.197095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:55:11.197095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:55:11.197095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:11.197572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:11.198091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:11.198091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.198091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:11.392618 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:11.392901 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:11.393230 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:11.393411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.393811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:11.393811 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:11.393811 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:11.393811 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:11.393811 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:11.393811 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:11.393811 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.393811 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:11.394309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.394309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:11.394309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:11.394309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:11.394309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:11.394309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:11.394309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:11.394309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:11.394309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:11.394309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:11.394309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:11.394309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:11.394309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:11.394309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:11.394309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:11.394309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:11.394845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:11.394845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:11.394845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:11.394845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:11.394845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:11.394845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:11.394845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.394845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:11.395213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.395213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:11.395213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:11.395213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:11.395213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:11.395213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:11.395213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:11.395213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:11.395213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:11.395213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:11.395213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:11.395213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:11.395213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:11.395213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:55:11.395213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:55:11.395213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:11.395796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:11.396474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.396474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:11.457194 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:11.458574 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:11.459328 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:11.459758 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:11.460013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.460832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:11.460832 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:11.460832 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:11.460832 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:11.460832 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:11.460832 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:11.460832 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.460832 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:11.462007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.462007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:11.462007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:11.462007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:11.462007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:11.462007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:11.462007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:11.462007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:11.462007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:11.462007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:11.462007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:11.462007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:11.462007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:11.462007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:55:11.462007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:11.462007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:11.462007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:11.462465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:15.796383 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:15.805614 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 07 19:55:15.805765 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=104575) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 07 19:55:15.805898 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Maintenance task: Fixing resource bfbf6c8f-1f7e-474c-a618-4e99355c0282 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:55:15.841450 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, resource={'id': 'bfbf6c8f-1f7e-474c-a618-4e99355c0282', 'name': 'private', 'tenant_id': '47ea4a7c5a154b528631c5537cfdb850', 'project_id': '47ea4a7c5a154b528631c5537cfdb850', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['49f10797-7993-4eac-ad9c-5db13bcf3a17', 'bdd6f685-b77d-459b-b386-e3ef09898997'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:35:01Z', 'updated_at': '2026-04-07T19:35:05Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39614}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:15.841747 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:15.842357 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-ca0b7fb0-3499-4804-b894-4bb867203f37, external_ids_update=None, columns={'tag': 39614}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:15.842357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:15.842956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 19:55:15.842956 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:15.842956 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:15.842956 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:15.842956 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:15.842956 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:15.842956 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:15.842956 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:15.844391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Maintenance task: Failed to fix resource bfbf6c8f-1f7e-474c-a618-4e99355c0282 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:15.844391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:55:15.844391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:55:15.844391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:55:15.844391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:55:15.844391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:55:15.844391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 19:55:15.844391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:15.844391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:15.844391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:55:15.844391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:15.845019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:15.845019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:15.845019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:55:15.845019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:15.845019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:55:15.845019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:15.845019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:55:15.845019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:55:15.845019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:15.845019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:55:15.845019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:15.845019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:55:15.845019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:55:15.845019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:15.845696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:55:15.845696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:15.845696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:55:15.845696 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Maintenance task: Fixing resource 92857a9a-261a-45c8-bdf2-793e5d5977e1 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:55:15.879234 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, resource={'id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'name': 'public', 'tenant_id': '47ea4a7c5a154b528631c5537cfdb850', 'project_id': '47ea4a7c5a154b528631c5537cfdb850', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['158905cc-b5be-42da-8777-3d7ded042b7c', '6de186a3-9e7c-4950-a1c6-817a37a68984'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-07T19:35:09Z', 'updated_at': '2026-04-07T19:35:17Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:15.880486 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:15.880865 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-783e27a6-53d0-42e0-a778-7125c7a0cff1, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:15.881105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:15.881941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 19:55:15.881941 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:15.881941 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:15.881941 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:15.881941 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:15.881941 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:15.881941 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:15.881941 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:15.883495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Maintenance task: Failed to fix resource 92857a9a-261a-45c8-bdf2-793e5d5977e1 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:15.883495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:55:15.883495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:55:15.883495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:55:15.883495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:55:15.883495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:55:15.883495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 19:55:15.883495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:15.883495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:15.883495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:55:15.883495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:15.883863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:15.883863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:15.883863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:55:15.883863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:15.883863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:55:15.883863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:15.883863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:55:15.883863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:55:15.883863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:15.883863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:55:15.883863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:15.883863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:55:15.883863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:55:15.883863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:15.884269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:55:15.884269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:15.884269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:55:15.884269 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Maintenance task: Fixing resource 246975ba-4717-4c89-a181-15f0da115b38 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:55:15.912227 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-246975ba-4717-4c89-a181-15f0da115b38, resource={'id': '246975ba-4717-4c89-a181-15f0da115b38', 'name': 'admin_net', 'tenant_id': 'c55e43aaf6164fb7ba8075ffd24bc8d2', 'project_id': 'c55e43aaf6164fb7ba8075ffd24bc8d2', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['4b75275b-2834-446a-a1bf-6e510e154273'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:40:24Z', 'updated_at': '2026-04-07T19:40:25Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 64449}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:15.913095 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-246975ba-4717-4c89-a181-15f0da115b38, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:15.913270 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-f0065b7a-ceb5-4313-9c13-1796e417df18, external_ids_update=None, columns={'tag': 64449}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:15.913456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:15.914357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 19:55:15.914357 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:15.914357 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:15.914357 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:15.914357 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:15.914357 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:15.914357 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:15.914357 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:15.915460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Maintenance task: Failed to fix resource 246975ba-4717-4c89-a181-15f0da115b38 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:15.915460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:55:15.915460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:55:15.915460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:55:15.915460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:55:15.915460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:55:15.915460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 19:55:15.915460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:15.915460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:15.915460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:55:15.915460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:15.915842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:15.915842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:15.915842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:55:15.915842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:15.915842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:55:15.915842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:15.915842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:55:15.915842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:55:15.915842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:15.915842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:55:15.915842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:15.915842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:55:15.915842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:55:15.915842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:15.916251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:55:15.916251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:15.916251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:55:15.916251 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Maintenance task: Fixing resource 40ad0605-2aac-4da1-b108-03821a0aa715 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:55:15.944594 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-40ad0605-2aac-4da1-b108-03821a0aa715, resource={'id': '40ad0605-2aac-4da1-b108-03821a0aa715', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'tenant_id': '7e48d42664ae4580840a2aef59d52e53', 'project_id': '7e48d42664ae4580840a2aef59d52e53', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['afc68917-6901-4e08-99ad-5c3d8bb8a584'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:41:05Z', 'updated_at': '2026-04-07T19:41:05Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 12961}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:15.945059 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-40ad0605-2aac-4da1-b108-03821a0aa715, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:15.945622 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-7853e8c0-165f-48a8-8e65-36b87d07f16a, external_ids_update=None, columns={'tag': 12961}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:15.945801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:15.946693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 19:55:15.946693 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:15.946693 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:15.946693 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:15.946693 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:15.946693 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:15.946693 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:15.946693 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:15.947935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Maintenance task: Failed to fix resource 40ad0605-2aac-4da1-b108-03821a0aa715 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:15.947935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:55:15.947935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:55:15.947935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:55:15.947935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:55:15.947935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:55:15.947935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 19:55:15.947935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:15.947935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:15.947935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:55:15.947935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:15.948390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:15.948390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:15.948390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:55:15.948390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:15.948390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:55:15.948390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:15.948390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:55:15.948390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:55:15.948390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:15.948390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:55:15.948390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:15.948390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:55:15.948390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:55:15.948390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:15.948740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:55:15.948740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:15.948740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:55:15.948740 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Maintenance task: Fixing resource 6e977c5e-85a0-4398-b359-5ba638de167e (type: routers) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:55:16.022210 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:16.023374 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, resource={'id': '6e977c5e-85a0-4398-b359-5ba638de167e', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'project_id': '7e48d42664ae4580840a2aef59d52e53', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'external_fixed_ips': [{'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984', 'ip_address': '172.24.5.89'}, {'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c', 'ip_address': '2001:db8::d'}], 'enable_snat': True}, 'gw_port_id': '7f6e42e8-6279-4fd6-9649-d7b189f6dba8', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-a48jf', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'external_fixed_ips': [{'ip_address': '172.24.5.89', 'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984'}, {'ip_address': '2001:db8::d', 'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-07T19:41:06Z', 'updated_at': '2026-04-07T19:41:09Z', 'revision_number': 3, 'tenant_id': '7e48d42664ae4580840a2aef59d52e53'}, resource_type=routers, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:16.023928 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:16.024321 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "7f6e42e8-6279-4fd6-9649-d7b189f6dba8"')], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:16.024546 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "7f6e42e8-6279-4fd6-9649-d7b189f6dba8"')], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:16.024880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.025589 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:16.026596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 19:55:16.026596 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:16.026596 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:16.026596 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:16.026596 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:16.026596 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:16.026596 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.026596 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:16.026841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Unable to update router 6e977c5e-85a0-4398-b359-5ba638de167e. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.028489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Maintenance task: Failed to fix resource 6e977c5e-85a0-4398-b359-5ba638de167e (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.028489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:55:16.028489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:55:16.028489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:55:16.028489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:55:16.028489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:55:16.028489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 07 19:55:16.028489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 07 19:55:16.028489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 07 19:55:16.028489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 07 19:55:16.028489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 07 19:55:16.029269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 07 19:55:16.029269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 07 19:55:16.029269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:16.029269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.029269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:55:16.029269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:16.029269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:16.029269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.029269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:55:16.029269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:16.029269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:55:16.029269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:16.029269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:55:16.029269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:55:16.029727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:16.029727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:55:16.029727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:16.029727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:55:16.029727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:55:16.029727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:16.029727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:55:16.029727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.029727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:55:16.029727 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Maintenance task: Fixing resource 7f6e42e8-6279-4fd6-9649-d7b189f6dba8 (type: router_ports) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 19:55:16.077789 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:16.080722 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:16.080876 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:16.081010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.086872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:55:16.086872 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:16.086872 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:16.086872 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:16.086872 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:16.086872 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:16.086872 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.086872 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:16.091365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.091365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:16.091365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:16.091365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:16.091365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:16.091365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:16.091365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:16.091365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:16.091365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:16.091365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:16.091365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:16.091365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:16.091365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:16.091365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:55:16.091365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:16.091365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.092389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:16.102654 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:16.103166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.105245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:55:16.105245 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:16.105245 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:16.105245 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:16.105245 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:16.105245 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:16.105245 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.105245 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:16.106925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.106925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:16.106925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:16.106925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:16.106925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:16.106925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:16.106925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:16.106925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:16.106925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:16.106925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:16.106925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:16.106925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:16.106925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:16.106925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:55:16.106925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:16.106925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.106925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.107795 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:16.182008 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, resource={'id': '7f6e42e8-6279-4fd6-9649-d7b189f6dba8', 'name': '', 'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'project_id': '', 'mac_address': 'fa:16:3e:18:2e:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e977c5e-85a0-4398-b359-5ba638de167e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984', 'ip_address': '172.24.5.89'}, {'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c', 'ip_address': '2001:db8::d'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000164077', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-07T19:41:06Z', 'updated_at': '2026-04-07T19:41:09Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:16.182252 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '6de186a3-9e7c-4950-a1c6-817a37a68984 158905cc-b5be-42da-8777-3d7ded042b7c', 'neutron:network_name': 'neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-6e977c5e-85a0-4398-b359-5ba638de167e'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::d/64', '172.24.5.89/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:16.182600 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=7f6e42e8-6279-4fd6-9649-d7b189f6dba8, lrouter_port=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:16.182833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.183445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 19:55:16.183445 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:16.183445 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:16.183445 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:16.183445 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:16.183445 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:16.183445 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.183445 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:16.184237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Maintenance task: Failed to fix resource 7f6e42e8-6279-4fd6-9649-d7b189f6dba8 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.184237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 19:55:16.184237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 19:55:16.184237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 19:55:16.184237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 19:55:16.184237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 19:55:16.184237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 07 19:55:16.184237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:16.184237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.184237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:55:16.184237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:16.185223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:16.185223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.185223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 19:55:16.185223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:16.185223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 19:55:16.185223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:16.185223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 19:55:16.185223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 19:55:16.185223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:16.185223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 19:55:16.185223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:16.185223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 19:55:16.185223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 19:55:16.185223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:16.186340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 19:55:16.186340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.186340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 19:55:16.186340 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Maintenance task: Synchronization completed (took 0.38 seconds)
Apr 07 19:55:16.193267 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:16.193928 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:55:16.194486 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:16.194624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.195236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:55:16.195236 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:16.195236 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:16.195236 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:16.195236 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:16.195236 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:16.195236 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.195236 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:16.196652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.196652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:16.196652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:16.196652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:16.196652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.196652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:16.196652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:16.196652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:16.196652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.196652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:16.196652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:16.196652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:16.196652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:16.196652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:16.196652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:16.197799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:16.197799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:16.197799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:16.197799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:16.197799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:16.197799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:16.197799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:16.197799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.197799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:16.199008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.199008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:16.199008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:16.199008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:16.199008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:16.199008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:16.199008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:16.199008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:16.199008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:16.199008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:16.199008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:16.199008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:16.199008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:16.199008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:55:16.199008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:55:16.199008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:16.200062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:16.200959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:16.200959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.200959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:16.394094 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:16.394094 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:16.394756 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:16.395291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.396157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:16.396157 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:16.396157 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:16.396157 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:16.396157 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:16.396157 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:16.396157 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.396157 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:16.397004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.397004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:16.397004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:16.397004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:16.397004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.397004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:16.397004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:16.397004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:16.397004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.397004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:16.397004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:16.397004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:16.397004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:16.397004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:16.397004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:16.397004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:16.397918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:16.397918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:16.397918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:16.397918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:16.397918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:16.397918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:16.397918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.397918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:16.398316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.398316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:16.398316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:16.398316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:16.398316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:16.398316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:16.398316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:16.398316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:16.398316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:16.398316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:16.398316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:16.398316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:16.398316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:16.398316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:55:16.398316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:55:16.398316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:16.399051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:16.400016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.400016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:16.458625 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:16.459296 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:16.459978 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:16.460415 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:16.460774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.461864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:16.461864 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:16.461864 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:16.461864 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:16.461864 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:16.461864 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:16.461864 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.461864 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:16.462738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.462738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:16.462738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:16.462738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:16.462738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:16.462738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:16.462738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:16.462738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:16.462738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:16.462738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:16.462738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:16.462738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:16.462738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:16.462738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:55:16.462738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:16.462738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.462738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:16.463237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:21.022745 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:21.024026 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:21.029622 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=431 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:55:21.060535 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:21.060721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.062068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:55:21.062068 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:21.062068 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:21.062068 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:21.062068 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:21.062068 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:21.062068 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.062068 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:21.062999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.062999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:21.062999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:21.062999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:21.062999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:21.062999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:21.062999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:21.062999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:21.062999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:21.062999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:21.062999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:21.062999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:21.062999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:21.062999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:55:21.062999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:21.062999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:21.062999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.063614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:21.078459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:21.079697 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:21.080042 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:21.080312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.081253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:55:21.081253 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:21.081253 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:21.081253 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:21.081253 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:21.081253 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:21.081253 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.081253 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:21.083008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.083008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:21.083008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:21.083008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:21.083008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:21.083008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:21.083008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:21.083008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:21.083008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:21.083008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:21.083008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:21.083008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:21.083008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:21.083008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:55:21.083008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:21.083008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.084066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:21.193849 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:21.194549 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:55:21.195079 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:21.195458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.196145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:55:21.196145 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:21.196145 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:21.196145 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:21.196145 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:21.196145 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:21.196145 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.196145 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:21.196954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.196954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:21.196954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:21.196954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:21.196954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:21.196954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:21.196954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:21.196954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:21.196954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:21.196954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:21.196954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:21.196954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:21.196954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:21.196954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:21.196954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:21.197770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:21.197770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:21.197770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:21.197770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:21.197770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:21.197770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:21.197770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:21.197770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.197770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:21.198233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.198233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:21.198233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:21.198233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:21.198233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:21.198233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:21.198233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:21.198233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:21.198233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:21.198233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:21.198233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:21.198233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:21.198233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:21.198233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:55:21.198233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:55:21.198233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:21.199278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:21.200448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:21.200448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.200448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:21.394211 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:21.394608 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:21.395666 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:21.396470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.398085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:21.398085 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:21.398085 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:21.398085 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:21.398085 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:21.398085 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:21.398085 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.398085 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:21.399755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.399755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:21.399755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:21.399755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:21.399755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:21.399755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:21.399755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:21.399755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:21.399755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:21.399755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:21.399755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:21.399755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:21.399755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:21.399755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:21.399755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:21.399755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:21.401050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:21.401050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:21.401050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:21.401050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:21.401050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:21.401050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:21.401050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.401050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:21.401955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.401955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:21.401955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:21.401955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:21.401955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:21.401955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:21.401955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:21.401955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:21.401955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:21.401955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:21.401955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:21.401955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:21.401955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:21.401955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:55:21.401955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:55:21.401955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:21.402798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:21.403634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.403634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:21.459365 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:21.459845 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:21.460824 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:21.461145 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:21.461392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.462132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:21.462132 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:21.462132 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:21.462132 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:21.462132 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:21.462132 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:21.462132 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.462132 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:21.463666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.463666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:21.463666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:21.463666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:21.463666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:21.463666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:21.463666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:21.463666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:21.463666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:21.463666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:21.463666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:21.463666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:21.463666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:21.463666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:55:21.463666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:21.463666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:21.463666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:21.464779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:26.023663 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:26.024519 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:26.056484 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:26.057574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.057705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:55:26.057705 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:26.057705 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:26.057705 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:26.057705 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:26.057705 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:26.057705 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.057705 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:26.058781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.058781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:26.058781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:26.058781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:26.058781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:26.058781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:26.058781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:26.058781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:26.058781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:26.058781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:26.058781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:26.058781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:26.058781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:26.058781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:55:26.058781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:26.058781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:26.058781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.059214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:26.079190 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:26.080270 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:26.080594 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:26.080836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.081867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:55:26.081867 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:26.081867 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:26.081867 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:26.081867 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:26.081867 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:26.081867 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.081867 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:26.083565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.083565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:26.083565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:26.083565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:26.083565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:26.083565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:26.083565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:26.083565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:26.083565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:26.083565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:26.083565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:26.083565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:26.083565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:26.083565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:55:26.083565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:26.083565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.084522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:26.194506 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:26.195074 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:55:26.195995 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:26.196379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.197193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:55:26.197193 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:26.197193 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:26.197193 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:26.197193 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:26.197193 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:26.197193 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.197193 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:26.198078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.198078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:26.198078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:26.198078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:26.198078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:26.198078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:26.198078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:26.198078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:26.198078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:26.198078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:26.198078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:26.198078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:26.198078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:26.198078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:26.198078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:26.198503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:26.198503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:26.198503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:26.198503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:26.198503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:26.198503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:26.198503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:26.198503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.198503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:26.199169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.199169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:26.199169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:26.199169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:26.199169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:26.199169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:26.199169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:26.199169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:26.199169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:26.199169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:26.199169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:26.199169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:26.199169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:26.199169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:55:26.199169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:55:26.199169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:26.199810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:26.200640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:26.200640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.200640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:26.394954 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:26.395487 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:26.396154 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:26.396421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.397104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:26.397104 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:26.397104 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:26.397104 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:26.397104 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:26.397104 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:26.397104 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.397104 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:26.398678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.398678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:26.398678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:26.398678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:26.398678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:26.398678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:26.398678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:26.398678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:26.398678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:26.398678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:26.398678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:26.398678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:26.398678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:26.398678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:26.398678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:26.398678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:26.399441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:26.399441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:26.399441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:26.399441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:26.399441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:26.399441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:26.399441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.399441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:26.400556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.400556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:26.400556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:26.400556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:26.400556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:26.400556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:26.400556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:26.400556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:26.400556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:26.400556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:26.400556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:26.400556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:26.400556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:26.400556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:55:26.400556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:55:26.400556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:26.401009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:26.401573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.401573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:26.460016 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:26.460610 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:26.460899 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:26.461243 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:26.461243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.462013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:26.462013 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:26.462013 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:26.462013 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:26.462013 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:26.462013 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:26.462013 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.462013 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:26.462972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.462972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:26.462972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:26.462972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:26.462972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:26.462972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:26.462972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:26.462972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:26.462972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:26.462972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:26.462972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:26.462972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:26.462972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:26.462972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:55:26.462972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:26.462972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:26.462972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:26.463883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:31.024321 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:31.025307 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:31.051189 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:31.051445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.052084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:55:31.052084 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:31.052084 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:31.052084 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:31.052084 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:31.052084 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:31.052084 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.052084 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:31.053059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.053059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:31.053059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:31.053059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:31.053059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:31.053059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:31.053059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:31.053059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:31.053059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:31.053059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:31.053059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:31.053059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:31.053059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:31.053059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:55:31.053059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:31.053059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:31.053059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.054243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:31.079717 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:31.080640 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:31.080949 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:31.081207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.081955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:55:31.081955 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:31.081955 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:31.081955 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:31.081955 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:31.081955 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:31.081955 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.081955 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:31.082770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.082770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:31.082770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:31.082770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:31.082770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:31.082770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:31.082770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:31.082770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:31.082770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:31.082770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:31.082770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:31.082770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:31.082770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:31.082770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:55:31.082770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:31.082770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.083432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:31.195076 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:31.195694 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:55:31.196568 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:31.196936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.197824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:55:31.197824 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:31.197824 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:31.197824 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:31.197824 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:31.197824 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:31.197824 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.197824 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:31.199141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.199141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:31.199141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:31.199141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:31.199141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:31.199141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:31.199141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:31.199141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:31.199141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:31.199141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:31.199141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:31.199141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:31.199141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:31.199141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:31.199141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:31.200058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:31.200058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:31.200058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:31.200058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:31.200058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:31.200058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:31.200058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:31.200058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.200058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:31.200907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.200907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:31.200907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:31.200907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:31.200907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:31.200907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:31.200907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:31.200907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:31.200907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:31.200907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:31.200907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:31.200907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:31.200907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:31.200907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:55:31.200907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:55:31.200907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:31.201734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:31.202748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:31.202748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.202748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:31.395666 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:31.396131 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:31.396668 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:31.396936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.397525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:31.397525 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:31.397525 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:31.397525 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:31.397525 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:31.397525 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:31.397525 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.397525 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:31.398474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.398474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:31.398474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:31.398474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:31.398474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:31.398474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:31.398474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:31.398474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:31.398474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:31.398474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:31.398474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:31.398474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:31.398474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:31.398474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:31.398474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:31.398474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:31.399487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:31.399487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:31.399487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:31.399487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:31.399487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:31.399487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:31.399487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.399487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:31.399870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.399870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:31.399870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:31.399870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:31.399870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:31.399870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:31.399870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:31.399870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:31.399870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:31.399870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:31.399870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:31.399870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:31.399870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:31.399870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:55:31.399870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:55:31.399870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:31.400383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:31.400950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.400950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:31.460882 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:31.461430 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:31.462107 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:31.462575 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:31.462879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.464221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:31.464221 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:31.464221 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:31.464221 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:31.464221 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:31.464221 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:31.464221 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.464221 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:31.465657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.465657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:31.465657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:31.465657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:31.465657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:31.465657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:31.465657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:31.465657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:31.465657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:31.465657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:31.465657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:31.465657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:31.465657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:31.465657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:55:31.465657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:31.465657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:31.465657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:31.466622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:36.024972 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:36.026188 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:36.058693 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:36.059108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.059672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:55:36.059672 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:36.059672 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:36.059672 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:36.059672 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:36.059672 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:36.059672 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.059672 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:36.060597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.060597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:36.060597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:36.060597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:36.060597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:36.060597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:36.060597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:36.060597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:36.060597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:36.060597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:36.060597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:36.060597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:36.060597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:36.060597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:55:36.060597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:36.060597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:36.060597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.061400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:36.080556 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:36.081575 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:36.081953 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:36.082157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.083045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:55:36.083045 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:36.083045 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:36.083045 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:36.083045 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:36.083045 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:36.083045 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.083045 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:36.084230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.084230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:36.084230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:36.084230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:36.084230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:36.084230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:36.084230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:36.084230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:36.084230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:36.084230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:36.084230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:36.084230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:36.084230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:36.084230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:55:36.084230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:36.084230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.085104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:36.195731 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:36.196338 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:55:36.197175 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:36.197503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.198373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:55:36.198373 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:36.198373 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:36.198373 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:36.198373 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:36.198373 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:36.198373 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.198373 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:36.199362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.199362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:36.199362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:36.199362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:36.199362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:36.199362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:36.199362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:36.199362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:36.199362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:36.199362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:36.199362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:36.199362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:36.199362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:36.199362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:36.199362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:36.200160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:36.200160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:36.200160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:36.200160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:36.200160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:36.200160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:36.200160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:36.200160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.200160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:36.200759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.200759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:36.200759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:36.200759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:36.200759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:36.200759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:36.200759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:36.200759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:36.200759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:36.200759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:36.200759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:36.200759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:36.200759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:36.200759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:55:36.200759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:55:36.200759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:36.201505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:36.202357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:36.202357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.202357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:36.396202 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:36.396682 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:36.397305 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:36.397671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.398220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:36.398220 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:36.398220 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:36.398220 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:36.398220 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:36.398220 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:36.398220 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.398220 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:36.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:36.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:36.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:36.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:36.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:36.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:36.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:36.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:36.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:36.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:36.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:36.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:36.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:36.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:36.400107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:36.401090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:36.401090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:36.401090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:36.401090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:36.401090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:36.401090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:36.401090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.401090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:36.401090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.401090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:36.401090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:36.401090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:36.401090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:36.401090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:36.401090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:36.401090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:36.402233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:36.403092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:36.403092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:36.403092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:36.403092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:36.403092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:36.403092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:36.403092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:36.403092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.403092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:36.461339 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:36.461784 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:36.462395 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:36.462672 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:36.462821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.463484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:36.463484 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:36.463484 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:36.463484 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:36.463484 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:36.463484 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:36.463484 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.463484 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:36.464555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.464555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:36.464555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:36.464555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:36.464555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:36.464555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:36.464555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:36.464555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:36.464555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:36.464555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:36.464555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:36.464555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:36.464555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:36.464555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:55:36.464555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:36.464555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:36.464555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:36.465482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:41.025814 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:41.027058 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:41.059163 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:41.059506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.060483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:55:41.060483 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:41.060483 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:41.060483 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:41.060483 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:41.060483 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:41.060483 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.060483 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:41.061753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.061753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:41.061753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:41.061753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:41.061753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:41.061753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:41.061753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:41.061753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:41.061753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:41.061753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:41.061753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:41.061753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:41.061753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:41.061753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:55:41.061753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:41.061753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:41.061753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.062337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:41.081020 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:41.082851 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:41.083057 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:41.083408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.084731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:55:41.084731 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:41.084731 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:41.084731 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:41.084731 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:41.084731 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:41.084731 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.084731 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:41.086319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.086319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:41.086319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:41.086319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:41.086319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:41.086319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:41.086319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:41.086319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:41.086319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:41.086319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:41.086319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:41.086319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:41.086319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:41.086319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:55:41.086319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:41.086319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.087481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:41.196678 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:41.196961 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:55:41.197649 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:41.197935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.198728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:55:41.198728 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:41.198728 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:41.198728 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:41.198728 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:41.198728 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:41.198728 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.198728 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:41.199845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.199845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:41.199845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:41.199845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:41.199845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:41.199845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:41.199845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:41.199845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:41.199845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:41.199845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:41.199845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:41.199845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:41.199845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:41.199845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:41.199845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:41.200530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:41.200530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:41.200530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:41.200530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:41.200530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:41.200530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:41.200530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:41.200530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.200530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:41.200825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.200825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:41.200825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:41.200825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:41.200825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:41.200825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:41.200825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:41.200825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:41.200825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:41.200825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:41.200825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:41.200825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:41.200825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:41.200825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:55:41.200825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:55:41.200825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:41.201298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:41.201802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:41.201802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.201802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:41.396735 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:41.397452 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:41.397956 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:41.398429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.399307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:41.399307 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:41.399307 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:41.399307 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:41.399307 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:41.399307 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:41.399307 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.399307 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:41.400419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.400419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:41.400419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:41.400419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:41.400419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:41.400419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:41.400419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:41.400419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:41.400419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:41.400419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:41.400419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:41.400419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:41.400419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:41.400419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:41.400419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:41.400419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:41.401093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:41.401093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:41.401093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:41.401093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:41.401093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:41.401093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:41.401093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.401093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:41.401782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.401782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:41.401782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:41.401782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:41.401782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:41.401782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:41.401782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:41.401782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:41.401782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:41.401782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:41.401782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:41.401782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:41.401782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:41.401782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:55:41.401782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:55:41.401782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:41.402490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:41.403238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.403238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:41.462016 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:41.462601 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:41.463267 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:41.463571 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:41.463777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.464635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:41.464635 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:41.464635 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:41.464635 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:41.464635 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:41.464635 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:41.464635 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.464635 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:41.466775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.466775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:41.466775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:41.466775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:41.466775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:41.466775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:41.466775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:41.466775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:41.466775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:41.466775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:41.466775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:41.466775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:41.466775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:41.466775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:55:41.466775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:41.466775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:41.466775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:41.467291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:46.026520 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:46.028438 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:46.066208 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:46.066208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.066460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:55:46.066460 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:46.066460 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:46.066460 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:46.066460 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:46.066460 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:46.066460 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.066460 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:46.067700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.067700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:46.067700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:46.067700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:46.067700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:46.067700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:46.067700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:46.067700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:46.067700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:46.067700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:46.067700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:46.067700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:46.067700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:46.067700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:55:46.067700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:46.067700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:46.067700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:46.082395 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:46.083484 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:46.083733 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:46.083880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.084732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:55:46.084732 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:46.084732 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:46.084732 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:46.084732 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:46.084732 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:46.084732 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.084732 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:46.085973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.085973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:46.085973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:46.085973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:46.085973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:46.085973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:46.085973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:46.085973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:46.085973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:46.085973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:46.085973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:46.085973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:46.085973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:46.085973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:55:46.085973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:46.085973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.086574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:46.197027 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:46.197900 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:55:46.198381 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:46.198743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.199813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:55:46.199813 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:46.199813 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:46.199813 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:46.199813 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:46.199813 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:46.199813 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.199813 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:46.201186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.201186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:46.201186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:46.201186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:46.201186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:46.201186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:46.201186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:46.201186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:46.201186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:46.201186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:46.201186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:46.201186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:46.201186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:46.201186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:46.201186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:46.202428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:46.202428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:46.202428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:46.202428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:46.202428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:46.202428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:46.202428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:46.202428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.202428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:46.203191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.203191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:46.203191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:46.203191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:46.203191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:46.203191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:46.203191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:46.203191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:46.203191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:46.203191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:46.203191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:46.203191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:46.203191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:46.203191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:55:46.203191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:55:46.203191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:46.204586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:46.205585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:46.205585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.205585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:46.397651 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:46.398083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:46.399226 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:46.399875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.400573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:46.400573 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:46.400573 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:46.400573 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:46.400573 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:46.400573 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:46.400573 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.400573 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:46.402596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.402596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:46.402596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:46.402596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:46.402596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:46.402596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:46.402596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:46.402596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:46.402596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:46.402596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:46.402596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:46.402596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:46.402596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:46.402596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:46.402596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:46.402596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:46.403100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:46.403100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:46.403100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:46.403100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:46.403100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:46.403100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:46.403100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.403100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:46.404210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.404210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:46.404210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:46.404210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:46.404210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:46.404210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:46.404210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:46.404210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:46.404210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:46.404210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:46.404210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:46.404210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:46.404210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:46.404210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:55:46.404210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:55:46.404210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:46.404692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:46.405192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.405192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:46.462913 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:46.463339 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:46.464289 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:46.464719 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:46.464965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.466271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:46.466271 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:46.466271 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:46.466271 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:46.466271 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:46.466271 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:46.466271 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.466271 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:46.467195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.467195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:46.467195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:46.467195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:46.467195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:46.467195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:46.467195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:46.467195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:46.467195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:46.467195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:46.467195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:46.467195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:46.467195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:46.467195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:55:46.467195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:46.467195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:46.467195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:46.467700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:51.027344 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:51.029250 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:51.065966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:51.066267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.066957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:55:51.066957 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:51.066957 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:51.066957 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:51.066957 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:51.066957 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:51.066957 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.066957 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:51.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:51.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:51.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:51.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:51.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:51.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:51.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:51.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:51.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:51.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:51.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:51.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:51.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:55:51.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:51.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:51.068156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.068644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:51.082979 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:51.083827 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:51.084086 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:51.084298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.084937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:55:51.084937 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:51.084937 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:51.084937 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:51.084937 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:51.084937 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:51.084937 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.084937 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:51.086557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.086557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:51.086557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:51.086557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:51.086557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:51.086557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:51.086557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:51.086557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:51.086557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:51.086557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:51.086557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:51.086557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:51.086557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:51.086557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:55:51.086557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:51.086557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.087202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:51.197824 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:51.198216 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:55:51.198923 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:51.199299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.200132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:55:51.200132 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:51.200132 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:51.200132 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:51.200132 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:51.200132 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:51.200132 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.200132 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:51.201031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.201031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:51.201031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:51.201031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:51.201031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:51.201031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:51.201031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:51.201031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:51.201031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:51.201031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:51.201031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:51.201031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:51.201031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:51.201031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:51.201031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:51.202173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:51.202173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:51.202173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:51.202173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:51.202173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:51.202173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:51.202173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:51.202173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.202173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:51.202708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.202708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:51.202708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:51.202708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:51.202708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:51.202708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:51.202708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:51.202708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:51.202708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:51.202708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:51.202708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:51.202708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:51.202708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:51.202708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:55:51.202708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:55:51.202708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:51.203699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:51.204787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:51.204787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.204787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:51.398472 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:51.398892 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:51.399605 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:51.400053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.400886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:51.400886 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:51.400886 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:51.400886 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:51.400886 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:51.400886 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:51.400886 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.400886 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:51.402261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.402261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:51.402261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:51.402261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:51.402261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:51.402261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:51.402261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:51.402261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:51.402261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:51.402261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:51.402261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:51.402261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:51.402261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:51.402261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:51.402261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:51.402261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:51.402994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:51.402994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:51.402994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:51.402994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:51.402994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:51.402994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:51.402994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.402994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:51.403602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.403602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:51.403602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:51.403602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:51.403602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:51.403602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:51.403602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:51.403602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:51.403602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:51.403602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:51.403602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:51.403602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:51.403602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:51.403602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:55:51.403602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:55:51.403602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:51.404350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:51.405217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.405217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:51.463360 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:51.463870 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:51.464237 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:51.464492 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:51.464648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.465196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:51.465196 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:51.465196 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:51.465196 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:51.465196 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:51.465196 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:51.465196 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.465196 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:51.466332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.466332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:51.466332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:51.466332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:51.466332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:51.466332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:51.466332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:51.466332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:51.466332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:51.466332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:51.466332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:51.466332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:51.466332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:51.466332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:55:51.466332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:51.466332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:51.466332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:51.467242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:56.028188 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:56.030056 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:56.068579 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:56.068860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.069644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:55:56.069644 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:56.069644 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:56.069644 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:56.069644 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:56.069644 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:56.069644 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.069644 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:56.070631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.070631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:56.070631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:56.070631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:56.070631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:56.070631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:56.070631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:56.070631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:56.070631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:56.070631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:56.070631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:56.070631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:56.070631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:56.070631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:55:56.070631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:56.070631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:56.070631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.071244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:56.083803 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:56.085565 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:56.086134 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:56.086539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.087706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:55:56.087706 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:56.087706 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:56.087706 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:56.087706 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:56.087706 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:56.087706 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.087706 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:56.089312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.089312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:56.089312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:56.089312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:56.089312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:56.089312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:56.089312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:56.089312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:56.089312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:56.089312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:56.089312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:56.089312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:56.089312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:56.089312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:55:56.089312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:56.089312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.090115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:56.198506 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:56.199142 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:55:56.200326 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:56.200642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.201565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:55:56.201565 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:56.201565 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:56.201565 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:56.201565 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:56.201565 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:56.201565 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.201565 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:56.203543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.203543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:56.203543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:56.203543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:56.203543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:56.203543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:56.203543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:56.203543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:56.203543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:56.203543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:56.203543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:56.203543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:56.203543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:56.203543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:56.203543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:56.204183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:56.204183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:56.204183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:56.204183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:56.204183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:56.204183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:56.204183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:56.204183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.204183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:56.205382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.205382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:56.205382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:56.205382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:56.205382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:56.205382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:56.205382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:56.205382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:56.205382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:56.205382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:56.205382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:56.205382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:56.205382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:56.205382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:55:56.205382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:55:56.205382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:56.206167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:56.206990 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:56.206990 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.206990 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:56.399181 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:56.399633 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:56.400838 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:56.401181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.401833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:56.401833 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:56.401833 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:56.401833 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:56.401833 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:56.401833 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:56.401833 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.401833 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:56.402720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.402720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:55:56.402720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:56.402720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:56.402720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:56.402720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:56.402720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:56.402720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:56.402720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:56.402720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:55:56.402720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:56.402720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:55:56.402720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:56.402720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:55:56.402720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:55:56.402720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:56.403589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:55:56.403589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:56.403589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:55:56.403589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:55:56.403589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:56.403589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:55:56.403589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.403589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:55:56.404017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.404017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:56.404017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:56.404017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:56.404017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:56.404017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:56.404017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:56.404017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:56.404017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:56.404017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:56.404017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:56.404017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:56.404017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:56.404017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:55:56.404017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:55:56.404017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:56.404843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:56.405754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.405754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:55:56.464448 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:55:56.464792 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:55:56.465145 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:56.465608 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:55:56.465608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.466312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:55:56.466312 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:56.466312 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:55:56.466312 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:55:56.466312 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:56.466312 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:55:56.466312 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.466312 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:55:56.467063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.467063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:55:56.467063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:55:56.467063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:55:56.467063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:55:56.467063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:55:56.467063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:56.467063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:55:56.467063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:55:56.467063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:55:56.467063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:55:56.467063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:55:56.467063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:55:56.467063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:55:56.467063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:55:56.467063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:56.467063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:55:56.468205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:01.028882 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:01.030296 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:01.066766 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:01.067274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.068179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:56:01.068179 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:01.068179 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:01.068179 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:01.068179 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:01.068179 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:01.068179 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.068179 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:01.069128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.069128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:01.069128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:01.069128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:01.069128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:01.069128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:01.069128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:01.069128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:01.069128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:01.069128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:01.069128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:01.069128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:01.069128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:01.069128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:56:01.069128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:01.069128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:01.069128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.070051 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:01.084412 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:01.085702 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:01.086028 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:01.086298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.087320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:56:01.087320 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:01.087320 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:01.087320 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:01.087320 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:01.087320 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:01.087320 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.087320 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:01.088865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.088865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:01.088865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:01.088865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:01.088865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:01.088865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:01.088865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:01.088865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:01.088865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:01.088865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:01.088865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:01.088865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:01.088865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:01.088865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:56:01.088865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:01.088865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.089341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:01.199392 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:01.200181 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:56:01.201117 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:01.201436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.202363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:56:01.202363 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:01.202363 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:01.202363 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:01.202363 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:01.202363 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:01.202363 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.202363 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:01.203866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.203866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:01.203866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:01.203866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:01.203866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:01.203866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:01.203866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:01.203866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:01.203866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:01.203866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:01.203866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:01.203866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:01.203866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:01.203866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:01.203866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:01.204639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:01.204639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:01.204639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:01.204639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:01.204639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:01.204639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:01.204639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:01.204639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.204639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:01.205142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.205142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:01.205142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:01.205142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:01.205142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:01.205142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:01.205142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:01.205142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:01.205142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:01.205142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:01.205142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:01.205142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:01.205142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:01.205142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:56:01.205142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:56:01.205142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:01.205628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:01.206202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:01.206202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.206202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:01.400086 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:01.400638 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:01.401297 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:01.401652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.402295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:01.402295 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:01.402295 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:01.402295 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:01.402295 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:01.402295 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:01.402295 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.402295 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:01.403243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.403243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:01.403243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:01.403243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:01.403243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:01.403243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:01.403243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:01.403243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:01.403243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:01.403243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:01.403243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:01.403243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:01.403243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:01.403243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:01.403243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:01.403243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:01.403714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:01.403714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:01.403714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:01.403714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:01.403714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:01.403714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:01.403714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.403714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:01.404482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.404482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:01.404482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:01.404482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:01.404482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:01.404482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:01.404482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:01.404482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:01.404482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:01.404482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:01.404482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:01.404482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:01.404482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:01.404482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:56:01.404482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:56:01.404482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:01.404964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:01.405534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.405534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:01.465146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:01.465728 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:01.466156 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:01.466533 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:01.466846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.467774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:01.467774 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:01.467774 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:01.467774 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:01.467774 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:01.467774 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:01.467774 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.467774 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:01.469718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.469718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:01.469718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:01.469718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:01.469718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:01.469718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:01.469718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:01.469718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:01.469718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:01.469718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:01.469718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:01.469718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:01.469718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:01.469718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:56:01.469718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:01.469718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:01.469718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:01.470508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:06.029760 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:06.031308 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:06.072730 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:06.073146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.073997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:56:06.073997 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:06.073997 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:06.073997 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:06.073997 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:06.073997 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:06.073997 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.073997 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:06.074935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.074935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:06.074935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:06.074935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:06.074935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:06.074935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:06.074935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:06.074935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:06.074935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:06.074935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:06.074935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:06.074935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:06.074935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:06.074935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:56:06.074935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:06.074935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:06.074935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.075545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:06.085112 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:06.086080 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:06.086350 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:06.086569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.087431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:56:06.087431 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:06.087431 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:06.087431 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:06.087431 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:06.087431 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:06.087431 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.087431 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:06.089203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.089203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:06.089203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:06.089203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:06.089203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:06.089203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:06.089203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:06.089203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:06.089203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:06.089203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:06.089203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:06.089203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:06.089203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:06.089203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:56:06.089203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:06.089203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.090030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:06.200190 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:06.200819 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:56:06.201590 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:06.201880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.202836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:56:06.202836 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:06.202836 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:06.202836 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:06.202836 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:06.202836 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:06.202836 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.202836 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:06.204215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.204215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:06.204215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:06.204215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:06.204215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:06.204215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:06.204215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:06.204215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:06.204215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:06.204215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:06.204215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:06.204215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:06.204215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:06.204215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:06.204215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:06.204973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:06.204973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:06.204973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:06.204973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:06.204973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:06.204973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:06.204973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:06.204973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.204973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:06.206399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.206399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:06.206399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:06.206399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:06.206399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:06.206399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:06.206399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:06.206399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:06.206399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:06.206399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:06.206399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:06.206399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:06.206399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:06.206399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:56:06.206399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:56:06.206399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:06.207213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:06.207975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:06.207975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.207975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:06.400855 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:06.401375 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:06.402221 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:06.402751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.403759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:06.403759 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:06.403759 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:06.403759 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:06.403759 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:06.403759 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:06.403759 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.403759 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:06.405490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.405490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:06.405490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:06.405490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:06.405490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:06.405490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:06.405490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:06.405490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:06.405490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:06.405490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:06.405490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:06.405490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:06.405490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:06.405490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:06.405490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:06.405490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:06.406238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:06.406238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:06.406238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:06.406238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:06.406238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:06.406238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:06.406238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.406238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:06.407739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.407739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:06.407739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:06.407739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:06.407739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:06.407739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:06.407739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:06.407739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:06.407739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:06.407739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:06.407739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:06.407739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:06.407739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:06.407739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:56:06.407739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:56:06.407739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:06.408515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:06.409295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.409295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:06.466315 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:06.466726 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:06.467547 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:06.467957 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:06.468219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.469360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:06.469360 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:06.469360 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:06.469360 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:06.469360 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:06.469360 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:06.469360 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.469360 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:06.471155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.471155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:06.471155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:06.471155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:06.471155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:06.471155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:06.471155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:06.471155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:06.471155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:06.471155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:06.471155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:06.471155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:06.471155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:06.471155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:56:06.471155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:06.471155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:06.471155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:06.472108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:11.030382 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:11.031311 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:11.062540 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:11.062900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.063761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:56:11.063761 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:11.063761 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:11.063761 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:11.063761 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:11.063761 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:11.063761 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.063761 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:11.065202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.065202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:11.065202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:11.065202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:11.065202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:11.065202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:11.065202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:11.065202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:11.065202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:11.065202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:11.065202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:11.065202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:11.065202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:11.065202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:56:11.065202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:11.065202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:11.065202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.065841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:11.085646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:11.086931 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:11.087215 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:11.087462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.088542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:56:11.088542 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:11.088542 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:11.088542 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:11.088542 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:11.088542 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:11.088542 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.088542 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:11.090419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.090419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:11.090419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:11.090419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:11.090419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:11.090419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:11.090419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:11.090419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:11.090419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:11.090419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:11.090419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:11.090419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:11.090419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:11.090419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:56:11.090419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:11.090419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.090912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:11.200786 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:11.201362 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:56:11.202124 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:11.202436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.203286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:56:11.203286 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:11.203286 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:11.203286 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:11.203286 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:11.203286 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:11.203286 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.203286 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:11.204162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.204162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:11.204162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:11.204162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:11.204162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:11.204162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:11.204162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:11.204162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:11.204162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:11.204162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:11.204162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:11.204162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:11.204162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:11.204162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:11.204162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:11.204642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:11.204642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:11.204642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:11.204642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:11.204642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:11.204642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:11.204642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:11.204642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.204642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:11.205296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.205296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:11.205296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:11.205296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:11.205296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:11.205296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:11.205296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:11.205296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:11.205296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:11.205296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:11.205296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:11.205296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:11.205296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:11.205296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:56:11.205296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:56:11.205296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:11.205811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:11.206347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:11.206347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.206347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:11.401596 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:11.401962 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:11.402604 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:11.403099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.403531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:11.403531 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:11.403531 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:11.403531 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:11.403531 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:11.403531 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:11.403531 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.403531 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:11.404398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.404398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:11.404398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:11.404398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:11.404398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:11.404398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:11.404398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:11.404398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:11.404398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:11.404398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:11.404398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:11.404398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:11.404398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:11.404398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:11.404398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:11.404398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:11.405003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:11.405003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:11.405003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:11.405003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:11.405003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:11.405003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:11.405003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.405003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:11.405407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.405407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:11.405407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:11.405407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:11.405407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:11.405407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:11.405407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:11.405407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:11.405407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:11.405407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:11.405407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:11.405407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:11.405407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:11.405407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:56:11.405407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:56:11.405407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:11.405850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:11.406344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.406344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:11.466934 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:11.467686 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:11.468557 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:11.469054 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:11.469309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.470452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:11.470452 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:11.470452 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:11.470452 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:11.470452 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:11.470452 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:11.470452 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.470452 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:11.472464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.472464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:11.472464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:11.472464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:11.472464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:11.472464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:11.472464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:11.472464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:11.472464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:11.472464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:11.472464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:11.472464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:11.472464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:11.472464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:56:11.472464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:11.472464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:11.472464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:11.473268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:16.031016 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:16.033149 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:16.116029 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:16.117868 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:16.118127 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:16.118291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.119661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:56:16.119661 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:16.119661 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:16.119661 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:16.119661 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:16.119661 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:16.119661 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.119661 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:16.122512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.122512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:16.122512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:16.122512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:16.122512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:16.122512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:16.122512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:16.122512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:16.122512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:16.122512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:16.122512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:16.122512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:16.122512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:16.122512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:56:16.122512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:16.122512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.122865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:16.135325 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:16.136131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.137025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:56:16.137025 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:16.137025 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:16.137025 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:16.137025 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:16.137025 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:16.137025 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.137025 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:16.137963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.137963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:16.137963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:16.137963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:16.137963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:16.137963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:16.137963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:16.137963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:16.137963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:16.137963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:16.137963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:16.137963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:16.137963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:16.137963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:56:16.137963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:16.137963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:16.137963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.138701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:16.201469 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:16.202364 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:56:16.203130 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:16.203523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.204448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:56:16.204448 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:16.204448 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:16.204448 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:16.204448 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:16.204448 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:16.204448 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.204448 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:16.205456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.205456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:16.205456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:16.205456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:16.205456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:16.205456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:16.205456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:16.205456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:16.205456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:16.205456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:16.205456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:16.205456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:16.205456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:16.205456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:16.205456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:16.206311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:16.206311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:16.206311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:16.206311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:16.206311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:16.206311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:16.206311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:16.206311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.206311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:16.206939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.206939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:16.206939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:16.206939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:16.206939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:16.206939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:16.206939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:16.206939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:16.206939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:16.206939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:16.206939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:16.206939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:16.206939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:16.206939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:56:16.206939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:56:16.206939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:16.207675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:16.208583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:16.208583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.208583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:16.402402 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:16.402802 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:16.403451 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:16.403877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.404699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:16.404699 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:16.404699 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:16.404699 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:16.404699 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:16.404699 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:16.404699 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.404699 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:16.405958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.405958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:16.405958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:16.405958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:16.405958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:16.405958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:16.405958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:16.405958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:16.405958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:16.405958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:16.405958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:16.405958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:16.405958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:16.405958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:16.405958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:16.405958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:16.406946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:16.406946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:16.406946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:16.406946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:16.406946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:16.406946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:16.406946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.406946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:16.407747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.407747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:16.407747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:16.407747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:16.407747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:16.407747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:16.407747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:16.407747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:16.407747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:16.407747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:16.407747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:16.407747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:16.407747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:16.407747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:56:16.407747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:56:16.407747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:16.408780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:16.410061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.410061 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:16.467669 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:16.468152 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:16.468729 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:16.469173 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:16.469414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.470279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:16.470279 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:16.470279 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:16.470279 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:16.470279 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:16.470279 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:16.470279 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.470279 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:16.471932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.471932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:16.471932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:16.471932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:16.471932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:16.471932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:16.471932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:16.471932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:16.471932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:16.471932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:16.471932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:16.471932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:16.471932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:16.471932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:56:16.471932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:16.471932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:16.471932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:16.472775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:21.031782 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:21.033556 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:21.035606 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=239 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:56:21.070456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:21.070668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.071521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:56:21.071521 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:21.071521 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:21.071521 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:21.071521 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:21.071521 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:21.071521 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.071521 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:21.072437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.072437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:21.072437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:21.072437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:21.072437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:21.072437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:21.072437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:21.072437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:21.072437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:21.072437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:21.072437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:21.072437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:21.072437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:21.072437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:56:21.072437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:21.072437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:21.072437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.073239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:21.115490 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:21.116759 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:21.117386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:21.117560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.118725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:56:21.118725 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:21.118725 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:21.118725 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:21.118725 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:21.118725 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:21.118725 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.118725 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:21.122353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.122353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:21.122353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:21.122353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:21.122353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:21.122353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:21.122353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:21.122353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:21.122353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:21.122353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:21.122353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:21.122353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:21.122353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:21.122353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:56:21.122353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:21.122353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.122896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:21.202088 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:21.202734 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:56:21.203355 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:21.203674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.204500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:56:21.204500 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:21.204500 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:21.204500 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:21.204500 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:21.204500 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:21.204500 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.204500 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:21.205468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.205468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:21.205468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:21.205468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:21.205468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:21.205468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:21.205468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:21.205468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:21.205468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:21.205468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:21.205468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:21.205468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:21.205468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:21.205468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:21.205468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:21.205904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:21.205904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:21.205904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:21.205904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:21.205904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:21.205904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:21.205904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:21.205904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.205904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:21.206694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.206694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:21.206694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:21.206694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:21.206694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:21.206694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:21.206694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:21.206694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:21.206694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:21.206694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:21.206694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:21.206694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:21.206694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:21.206694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:56:21.206694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:56:21.206694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:21.207201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:21.207742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:21.207742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.207742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:21.402957 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:21.403469 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:21.404191 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:21.404662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.405469 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:21.405469 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:21.405469 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:21.405469 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:21.405469 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:21.405469 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:21.405469 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.405469 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:21.406658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.406658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:21.406658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:21.406658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:21.406658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:21.406658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:21.406658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:21.406658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:21.406658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:21.406658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:21.406658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:21.406658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:21.406658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:21.406658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:21.406658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:21.406658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:21.407456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:21.407456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:21.407456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:21.407456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:21.407456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:21.407456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:21.407456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.407456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:21.408234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.408234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:21.408234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:21.408234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:21.408234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:21.408234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:21.408234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:21.408234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:21.408234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:21.408234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:21.408234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:21.408234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:21.408234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:21.408234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:56:21.408234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:56:21.408234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:21.409453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:21.410527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.410527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:21.468421 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:21.468898 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:21.469396 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:21.469645 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:21.469812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.470595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:21.470595 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:21.470595 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:21.470595 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:21.470595 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:21.470595 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:21.470595 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.470595 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:21.472394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.472394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:21.472394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:21.472394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:21.472394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:21.472394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:21.472394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:21.472394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:21.472394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:21.472394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:21.472394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:21.472394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:21.472394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:21.472394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:56:21.472394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:21.472394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:21.472394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:21.473336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:26.032471 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:26.034418 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:26.072954 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:26.073510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.074650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:56:26.074650 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:26.074650 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:26.074650 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:26.074650 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:26.074650 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:26.074650 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.074650 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:26.075840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.075840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:26.075840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:26.075840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:26.075840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:26.075840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:26.075840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:26.075840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:26.075840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:26.075840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:26.075840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:26.075840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:26.075840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:26.075840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:56:26.075840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:26.075840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:26.075840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.076760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:26.116102 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:26.117603 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:26.117977 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:26.118335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.119432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:56:26.119432 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:26.119432 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:26.119432 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:26.119432 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:26.119432 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:26.119432 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.119432 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:26.121769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.121769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:26.121769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:26.121769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:26.121769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:26.121769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:26.121769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:26.121769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:26.121769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:26.121769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:26.121769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:26.121769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:26.121769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:26.121769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:56:26.121769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:26.121769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.122833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:26.202757 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:26.203313 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:56:26.203850 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:26.204196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.205058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:56:26.205058 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:26.205058 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:26.205058 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:26.205058 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:26.205058 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:26.205058 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.205058 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:26.206334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.206334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:26.206334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:26.206334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:26.206334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:26.206334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:26.206334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:26.206334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:26.206334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:26.206334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:26.206334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:26.206334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:26.206334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:26.206334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:26.206334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:26.206704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:26.206704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:26.206704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:26.206704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:26.206704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:26.206704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:26.206704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:26.206704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.206704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:26.208209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.208209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:26.208209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:26.208209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:26.208209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:26.208209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:26.208209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:26.208209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:26.208209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:26.208209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:26.208209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:26.208209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:26.208209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:26.208209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:56:26.208209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:56:26.208209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:26.208584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:26.209058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:26.209058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.209058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:26.403516 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:26.404268 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:26.404852 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:26.405143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.405689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:26.405689 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:26.405689 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:26.405689 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:26.405689 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:26.405689 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:26.405689 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.405689 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:26.406709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.406709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:26.406709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:26.406709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:26.406709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:26.406709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:26.406709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:26.406709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:26.406709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:26.406709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:26.406709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:26.406709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:26.406709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:26.406709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:26.406709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:26.406709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:26.407583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:26.407583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:26.407583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:26.407583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:26.407583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:26.407583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:26.407583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.407583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:26.408211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.408211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:26.408211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:26.408211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:26.408211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:26.408211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:26.408211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:26.408211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:26.408211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:26.408211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:26.408211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:26.408211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:26.408211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:26.408211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:56:26.408211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:56:26.408211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:26.409025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:26.410177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.410177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:26.469300 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:26.470501 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:26.471492 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:26.471492 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:26.471492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.472167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:26.472167 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:26.472167 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:26.472167 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:26.472167 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:26.472167 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:26.472167 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.472167 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:26.473879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.473879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:26.473879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:26.473879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:26.473879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:26.473879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:26.473879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:26.473879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:26.473879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:26.473879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:26.473879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:26.473879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:26.473879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:26.473879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:56:26.473879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:26.473879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:26.473879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:26.475476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:31.033301 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:31.034960 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:31.069423 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:31.069812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.070751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:56:31.070751 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:31.070751 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:31.070751 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:31.070751 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:31.070751 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:31.070751 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.070751 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:31.072083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.072083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:31.072083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:31.072083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:31.072083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:31.072083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:31.072083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:31.072083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:31.072083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:31.072083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:31.072083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:31.072083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:31.072083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:31.072083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:56:31.072083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:31.072083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:31.072083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.073050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:31.116835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:31.118218 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:31.118510 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:31.118754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.119715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:56:31.119715 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:31.119715 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:31.119715 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:31.119715 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:31.119715 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:31.119715 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.119715 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:31.121520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.121520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:31.121520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:31.121520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:31.121520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:31.121520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:31.121520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:31.121520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:31.121520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:31.121520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:31.121520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:31.121520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:31.121520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:31.121520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:56:31.121520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:31.121520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.122045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:31.203496 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:31.204494 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:56:31.205183 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:31.205514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.206477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:56:31.206477 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:31.206477 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:31.206477 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:31.206477 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:31.206477 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:31.206477 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.206477 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:31.208399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.208399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:31.208399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:31.208399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:31.208399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:31.208399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:31.208399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:31.208399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:31.208399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:31.208399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:31.208399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:31.208399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:31.208399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:31.208399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:31.208399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:31.209322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:31.209322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:31.209322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:31.209322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:31.209322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:31.209322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:31.209322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:31.209322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.209322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:31.209797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.209797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:31.209797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:31.209797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:31.209797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:31.209797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:31.209797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:31.209797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:31.209797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:31.209797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:31.209797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:31.209797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:31.209797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:31.209797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:56:31.209797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:56:31.209797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:31.210737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:31.211722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:31.211722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.211722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:31.404456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:31.404904 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:31.405511 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:31.405935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.406780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:31.406780 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:31.406780 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:31.406780 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:31.406780 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:31.406780 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:31.406780 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.406780 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:31.408053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.408053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:31.408053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:31.408053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:31.408053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:31.408053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:31.408053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:31.408053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:31.408053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:31.408053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:31.408053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:31.408053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:31.408053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:31.408053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:31.408053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:31.408053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:31.408941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:31.408941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:31.408941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:31.408941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:31.408941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:31.408941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:31.408941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.408941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:31.409889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.409889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:31.409889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:31.409889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:31.409889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:31.409889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:31.409889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:31.409889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:31.409889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:31.409889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:31.409889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:31.409889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:31.409889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:31.409889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:56:31.409889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:56:31.409889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:31.410526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:31.411149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.411149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:31.470250 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:31.470824 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:31.471586 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:31.471934 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:31.472172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.472809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:31.472809 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:31.472809 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:31.472809 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:31.472809 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:31.472809 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:31.472809 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.472809 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:31.474502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.474502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:31.474502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:31.474502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:31.474502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:31.474502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:31.474502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:31.474502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:31.474502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:31.474502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:31.474502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:31.474502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:31.474502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:31.474502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:56:31.474502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:31.474502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:31.474502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:31.475017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:36.034024 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:36.035690 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:36.074456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:36.074821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.075733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:56:36.075733 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:36.075733 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:36.075733 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:36.075733 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:36.075733 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:36.075733 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.075733 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:36.076677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.076677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:36.076677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:36.076677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:36.076677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:36.076677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:36.076677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:36.076677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:36.076677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:36.076677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:36.076677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:36.076677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:36.076677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:36.076677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:56:36.076677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:36.076677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:36.076677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.077753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:36.118003 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:36.119630 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:36.119965 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:36.120317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.121425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:56:36.121425 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:36.121425 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:36.121425 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:36.121425 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:36.121425 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:36.121425 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.121425 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:36.123200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.123200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:36.123200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:36.123200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:36.123200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:36.123200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:36.123200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:36.123200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:36.123200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:36.123200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:36.123200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:36.123200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:36.123200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:36.123200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:56:36.123200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:36.123200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.123755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:36.204252 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:36.204941 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:56:36.205533 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:36.205741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.206414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:56:36.206414 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:36.206414 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:36.206414 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:36.206414 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:36.206414 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:36.206414 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.206414 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:36.207741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.207741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:36.207741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:36.207741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:36.207741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:36.207741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:36.207741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:36.207741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:36.207741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:36.207741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:36.207741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:36.207741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:36.207741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:36.207741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:36.207741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:36.208663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:36.208663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:36.208663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:36.208663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:36.208663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:36.208663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:36.208663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:36.208663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.208663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:36.209689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.209689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:36.209689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:36.209689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:36.209689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:36.209689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:36.209689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:36.209689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:36.209689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:36.209689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:36.209689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:36.209689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:36.209689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:36.209689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:56:36.209689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:56:36.209689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:36.210440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:36.211289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:36.211289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.211289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:36.405017 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:36.405521 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:36.406198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:36.406587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.407440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:36.407440 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:36.407440 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:36.407440 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:36.407440 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:36.407440 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:36.407440 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.407440 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:36.408295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.408295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:36.408295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:36.408295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:36.408295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:36.408295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:36.408295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:36.408295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:36.408295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:36.408295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:36.408295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:36.408295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:36.408295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:36.408295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:36.408295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:36.408295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:36.409109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:36.409109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:36.409109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:36.409109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:36.409109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:36.409109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:36.409109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.409109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:36.409473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.409473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:36.409473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:36.409473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:36.409473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:36.409473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:36.409473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:36.409473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:36.409473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:36.409473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:36.409473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:36.409473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:36.409473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:36.409473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:56:36.409473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:56:36.409473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:36.410484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:36.411546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.411546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:36.471066 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:36.471462 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:36.472083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:36.472484 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:36.472737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.473624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:36.473624 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:36.473624 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:36.473624 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:36.473624 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:36.473624 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:36.473624 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.473624 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:36.474691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.474691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:36.474691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:36.474691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:36.474691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:36.474691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:36.474691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:36.474691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:36.474691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:36.474691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:36.474691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:36.474691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:36.474691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:36.474691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:56:36.474691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:36.474691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:36.474691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:36.475276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:41.034768 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:41.036610 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:41.074417 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:41.074893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.076001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:56:41.076001 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:41.076001 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:41.076001 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:41.076001 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:41.076001 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:41.076001 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.076001 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:41.077290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.077290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:41.077290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:41.077290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:41.077290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:41.077290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:41.077290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:41.077290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:41.077290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:41.077290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:41.077290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:41.077290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:41.077290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:41.077290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:56:41.077290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:41.077290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:41.077290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.078318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:41.119020 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:41.120475 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:41.120943 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:41.121233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.122523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:56:41.122523 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:41.122523 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:41.122523 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:41.122523 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:41.122523 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:41.122523 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.122523 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:41.124499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.124499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:41.124499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:41.124499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:41.124499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:41.124499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:41.124499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:41.124499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:41.124499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:41.124499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:41.124499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:41.124499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:41.124499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:41.124499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:56:41.124499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:41.124499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.124954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:41.204917 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:41.205710 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:56:41.206865 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:41.207340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.208620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:56:41.208620 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:41.208620 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:41.208620 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:41.208620 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:41.208620 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:41.208620 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.208620 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:41.210114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.210114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:41.210114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:41.210114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:41.210114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:41.210114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:41.210114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:41.210114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:41.210114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:41.210114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:41.210114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:41.210114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:41.210114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:41.210114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:41.210114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:41.210773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:41.210773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:41.210773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:41.210773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:41.210773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:41.210773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:41.210773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:41.210773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.210773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:41.211839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.211839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:41.211839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:41.211839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:41.211839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:41.211839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:41.211839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:41.211839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:41.211839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:41.211839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:41.211839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:41.211839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:41.211839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:41.211839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:56:41.211839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:56:41.211839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:41.212967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:41.214025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:41.214025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.214025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:41.405822 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:41.406656 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:41.407565 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:41.407999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.409036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:41.409036 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:41.409036 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:41.409036 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:41.409036 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:41.409036 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:41.409036 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.409036 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:41.410383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.410383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:41.410383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:41.410383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:41.410383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:41.410383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:41.410383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:41.410383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:41.410383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:41.410383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:41.410383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:41.410383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:41.410383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:41.410383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:41.410383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:41.410383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:41.411333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:41.411333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:41.411333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:41.411333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:41.411333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:41.411333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:41.411333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.411333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:41.412105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.412105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:41.412105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:41.412105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:41.412105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:41.412105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:41.412105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:41.412105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:41.412105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:41.412105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:41.412105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:41.412105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:41.412105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:41.412105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:56:41.412105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:56:41.412105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:41.413187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:41.414084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.414084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:41.471694 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:41.472377 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:41.473589 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:41.473790 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:41.474028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.475091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:41.475091 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:41.475091 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:41.475091 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:41.475091 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:41.475091 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:41.475091 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.475091 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:41.477188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.477188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:41.477188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:41.477188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:41.477188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:41.477188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:41.477188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:41.477188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:41.477188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:41.477188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:41.477188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:41.477188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:41.477188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:41.477188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:56:41.477188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:41.477188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:41.477188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:41.478156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:46.035544 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:46.037373 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:46.074530 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:46.074933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.075874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:56:46.075874 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:46.075874 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:46.075874 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:46.075874 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:46.075874 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:46.075874 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.075874 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:46.077293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.077293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:46.077293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:46.077293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:46.077293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:46.077293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:46.077293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:46.077293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:46.077293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:46.077293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:46.077293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:46.077293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:46.077293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:46.077293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:56:46.077293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:46.077293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:46.077293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.078451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:46.119713 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:46.121290 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:46.121421 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:46.121819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.122596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:56:46.122596 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:46.122596 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:46.122596 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:46.122596 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:46.122596 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:46.122596 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.122596 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:46.124422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.124422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:46.124422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:46.124422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:46.124422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:46.124422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:46.124422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:46.124422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:46.124422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:46.124422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:46.124422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:46.124422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:46.124422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:46.124422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:56:46.124422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:46.124422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.125398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:46.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:46.206362 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:56:46.207005 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:46.207369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.208410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:56:46.208410 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:46.208410 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:46.208410 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:46.208410 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:46.208410 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:46.208410 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.208410 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:46.209735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.209735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:46.209735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:46.209735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:46.209735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:46.209735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:46.209735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:46.209735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:46.209735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:46.209735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:46.209735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:46.209735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:46.209735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:46.209735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:46.209735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:46.210686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:46.210686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:46.210686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:46.210686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:46.210686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:46.210686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:46.210686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:46.210686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.210686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:46.211630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.211630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:46.211630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:46.211630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:46.211630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:46.211630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:46.211630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:46.211630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:46.211630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:46.211630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:46.211630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:46.211630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:46.211630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:46.211630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:56:46.211630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:56:46.211630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:46.212570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:46.213504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:46.213504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.213504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:46.406515 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:46.406922 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:46.407416 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:46.407745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.408410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:46.408410 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:46.408410 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:46.408410 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:46.408410 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:46.408410 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:46.408410 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.408410 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:46.409423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.409423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:46.409423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:46.409423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:46.409423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:46.409423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:46.409423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:46.409423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:46.409423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:46.409423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:46.409423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:46.409423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:46.409423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:46.409423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:46.409423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:46.409423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:46.410166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:46.410166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:46.410166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:46.410166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:46.410166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:46.410166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:46.410166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.410166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:46.410782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.410782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:46.410782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:46.410782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:46.410782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:46.410782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:46.410782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:46.410782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:46.410782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:46.410782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:46.410782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:46.410782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:46.410782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:46.410782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:56:46.410782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:56:46.410782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:46.411504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:46.412323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.412323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:46.472326 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:46.472927 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:46.473555 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:46.473832 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:46.474081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.474746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:46.474746 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:46.474746 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:46.474746 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:46.474746 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:46.474746 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:46.474746 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.474746 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:46.476114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.476114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:46.476114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:46.476114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:46.476114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:46.476114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:46.476114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:46.476114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:46.476114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:46.476114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:46.476114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:46.476114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:46.476114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:46.476114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:56:46.476114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:46.476114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:46.476114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:46.477083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:51.036349 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:51.038113 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:51.072180 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:51.072442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.073175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:56:51.073175 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:51.073175 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:51.073175 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:51.073175 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:51.073175 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:51.073175 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.073175 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:51.074304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.074304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:51.074304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:51.074304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:51.074304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:51.074304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:51.074304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:51.074304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:51.074304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:51.074304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:51.074304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:51.074304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:51.074304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:51.074304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:56:51.074304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:51.074304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:51.074304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.074974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:51.120531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:51.121891 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:51.122164 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:51.122348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.123272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:56:51.123272 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:51.123272 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:51.123272 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:51.123272 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:51.123272 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:51.123272 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.123272 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:51.125262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.125262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:51.125262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:51.125262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:51.125262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:51.125262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:51.125262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:51.125262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:51.125262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:51.125262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:51.125262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:51.125262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:51.125262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:51.125262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:56:51.125262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:51.125262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.126059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:51.206430 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:51.206952 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:56:51.207635 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:51.207957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.208774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:56:51.208774 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:51.208774 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:51.208774 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:51.208774 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:51.208774 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:51.208774 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.208774 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:51.209671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.209671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:51.209671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:51.209671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:51.209671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:51.209671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:51.209671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:51.209671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:51.209671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:51.209671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:51.209671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:51.209671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:51.209671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:51.209671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:51.209671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:51.210507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:51.210507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:51.210507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:51.210507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:51.210507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:51.210507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:51.210507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:51.210507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.210507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:51.211147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.211147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:51.211147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:51.211147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:51.211147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:51.211147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:51.211147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:51.211147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:51.211147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:51.211147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:51.211147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:51.211147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:51.211147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:51.211147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:56:51.211147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:56:51.211147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:51.211871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:51.212389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:51.212389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.212389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:51.407177 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:51.407768 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:51.408419 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:51.408821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.409675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:51.409675 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:51.409675 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:51.409675 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:51.409675 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:51.409675 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:51.409675 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.409675 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:51.410965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.410965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:51.410965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:51.410965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:51.410965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:51.410965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:51.410965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:51.410965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:51.410965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:51.410965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:51.410965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:51.410965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:51.410965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:51.410965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:51.410965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:51.410965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:51.411744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:51.411744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:51.411744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:51.411744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:51.411744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:51.411744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:51.411744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.411744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:51.412583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.412583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:51.412583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:51.412583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:51.412583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:51.412583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:51.412583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:51.412583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:51.412583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:51.412583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:51.412583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:51.412583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:51.412583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:51.412583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:56:51.412583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:56:51.412583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:51.413392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:51.414265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.414265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:51.473024 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:51.473687 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:51.474331 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:51.474765 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:51.475015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.475928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:51.475928 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:51.475928 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:51.475928 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:51.475928 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:51.475928 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:51.475928 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.475928 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:51.477717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.477717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:51.477717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:51.477717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:51.477717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:51.477717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:51.477717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:51.477717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:51.477717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:51.477717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:51.477717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:51.477717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:51.477717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:51.477717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:56:51.477717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:51.477717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:51.477717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:51.478568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:56.037052 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:56.038063 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:56.071794 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:56.072486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.073170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:56:56.073170 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:56.073170 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:56.073170 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:56.073170 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:56.073170 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:56.073170 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.073170 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:56.073954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.073954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:56.073954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:56.073954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:56.073954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:56.073954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:56.073954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:56.073954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:56.073954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:56.073954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:56.073954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:56.073954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:56.073954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:56.073954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:56:56.073954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:56.073954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:56.073954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.074816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:56.121423 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:56.122697 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:56.122944 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:56.123137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.123946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:56:56.123946 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:56.123946 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:56.123946 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:56.123946 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:56.123946 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:56.123946 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.123946 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:56.125889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.125889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:56.125889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:56.125889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:56.125889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:56.125889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:56.125889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:56.125889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:56.125889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:56.125889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:56.125889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:56.125889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:56.125889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:56.125889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:56:56.125889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:56.125889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.126658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:56.207167 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:56.207797 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:56:56.208418 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:56.208831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.210139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:56:56.210139 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:56.210139 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:56.210139 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:56.210139 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:56.210139 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:56.210139 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.210139 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:56.211422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.211422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:56.211422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:56.211422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:56.211422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:56.211422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:56.211422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:56.211422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:56.211422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:56.211422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:56.211422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:56.211422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:56.211422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:56.211422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:56.211422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:56.212236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:56.212236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:56.212236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:56.212236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:56.212236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:56.212236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:56.212236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:56.212236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.212236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:56.212938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.212938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:56.212938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:56.212938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:56.212938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:56.212938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:56.212938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:56.212938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:56.212938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:56.212938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:56.212938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:56.212938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:56.212938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:56.212938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:56:56.212938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:56:56.212938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:56.213808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:56.214743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:56.214743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.214743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:56.407885 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:56.408359 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:56.408811 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:56.409148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.409730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:56.409730 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:56.409730 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:56.409730 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:56.409730 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:56.409730 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:56.409730 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.409730 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:56.411169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.411169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:56:56.411169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:56.411169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:56.411169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:56.411169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:56.411169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:56.411169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:56.411169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:56.411169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:56:56.411169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:56.411169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:56:56.411169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:56.411169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:56:56.411169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:56:56.411169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:56.411659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:56:56.411659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:56.411659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:56:56.411659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:56:56.411659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:56.411659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:56:56.411659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.411659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:56:56.413116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.413116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:56.413116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:56.413116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:56.413116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:56.413116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:56.413116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:56.413116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:56.413116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:56.413116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:56.413116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:56.413116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:56.413116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:56.413116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:56:56.413116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:56:56.413116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:56.413602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:56.414155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.414155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:56:56.473712 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:56:56.474281 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:56:56.474744 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:56.475063 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:56:56.475200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.475825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:56:56.475825 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:56.475825 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:56:56.475825 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:56:56.475825 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:56.475825 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:56:56.475825 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.475825 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:56:56.477755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.477755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:56:56.477755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:56:56.477755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:56:56.477755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:56:56.477755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:56:56.477755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:56.477755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:56:56.477755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:56:56.477755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:56:56.477755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:56:56.477755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:56:56.477755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:56:56.477755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:56:56.477755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:56:56.477755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:56.477755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:56:56.478747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:01.037741 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:01.039385 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:01.079090 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:01.079660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.081169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:57:01.081169 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:01.081169 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:01.081169 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:01.081169 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:01.081169 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:01.081169 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.081169 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:01.082331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.082331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:01.082331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:01.082331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:01.082331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:01.082331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:01.082331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:01.082331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:01.082331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:01.082331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:01.082331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:01.082331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:01.082331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:01.082331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:57:01.082331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:01.082331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:01.082331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.083259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:01.122484 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:01.123862 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:01.124209 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:01.124396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.125496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:57:01.125496 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:01.125496 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:01.125496 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:01.125496 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:01.125496 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:01.125496 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.125496 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:01.127473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.127473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:01.127473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:01.127473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:01.127473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:01.127473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:01.127473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:01.127473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:01.127473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:01.127473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:01.127473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:01.127473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:01.127473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:01.127473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:57:01.127473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:01.127473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.128307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:01.207936 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:01.208670 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:57:01.209530 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:01.209842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.210553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:57:01.210553 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:01.210553 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:01.210553 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:01.210553 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:01.210553 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:01.210553 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.210553 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:01.212086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.212086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:01.212086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:01.212086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:01.212086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:01.212086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:01.212086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:01.212086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:01.212086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:01.212086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:01.212086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:01.212086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:01.212086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:01.212086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:01.212086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:01.212574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:01.212574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:01.212574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:01.212574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:01.212574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:01.212574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:01.212574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:01.212574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.212574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:01.214144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.214144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:01.214144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:01.214144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:01.214144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:01.214144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:01.214144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:01.214144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:01.214144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:01.214144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:01.214144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:01.214144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:01.214144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:01.214144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:57:01.214144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:57:01.214144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:01.214902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:01.215756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:01.215756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.215756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:01.408580 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:01.408870 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:01.410114 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:01.410437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.411524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:01.411524 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:01.411524 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:01.411524 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:01.411524 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:01.411524 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:01.411524 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.411524 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:01.412976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.412976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:01.412976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:01.412976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:01.412976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:01.412976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:01.412976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:01.412976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:01.412976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:01.412976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:01.412976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:01.412976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:01.412976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:01.412976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:01.412976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:01.412976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:01.413713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:01.413713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:01.413713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:01.413713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:01.413713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:01.413713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:01.413713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.413713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:01.414756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.414756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:01.414756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:01.414756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:01.414756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:01.414756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:01.414756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:01.414756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:01.414756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:01.414756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:01.414756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:01.414756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:01.414756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:01.414756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:57:01.414756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:57:01.414756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:01.415494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:01.416298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.416298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:01.474393 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:01.474914 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:01.475809 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:01.476217 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:01.476597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.477407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:01.477407 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:01.477407 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:01.477407 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:01.477407 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:01.477407 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:01.477407 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.477407 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:01.478481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.478481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:01.478481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:01.478481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:01.478481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:01.478481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:01.478481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:01.478481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:01.478481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:01.478481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:01.478481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:01.478481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:01.478481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:01.478481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:57:01.478481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:01.478481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:01.478481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:01.479179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:06.038492 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:06.040224 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:06.080393 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:06.080642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.081009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:57:06.081009 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:06.081009 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:06.081009 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:06.081009 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:06.081009 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:06.081009 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.081009 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:06.081786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.081786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:06.081786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:06.081786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:06.081786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:06.081786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:06.081786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:06.081786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:06.081786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:06.081786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:06.081786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:06.081786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:06.081786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:06.081786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:57:06.081786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:06.081786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:06.081786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.082723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:06.123522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:06.125207 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:06.125540 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:06.125788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.126826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:57:06.126826 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:06.126826 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:06.126826 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:06.126826 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:06.126826 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:06.126826 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.126826 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:06.128608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.128608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:06.128608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:06.128608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:06.128608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:06.128608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:06.128608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:06.128608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:06.128608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:06.128608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:06.128608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:06.128608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:06.128608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:06.128608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:57:06.128608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:06.128608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.129350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:06.208835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:06.209439 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:57:06.210251 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:06.210524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.211405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:57:06.211405 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:06.211405 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:06.211405 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:06.211405 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:06.211405 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:06.211405 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.211405 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:06.212910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.212910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:06.212910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:06.212910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:06.212910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:06.212910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:06.212910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:06.212910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:06.212910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:06.212910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:06.212910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:06.212910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:06.212910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:06.212910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:06.212910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:06.213789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:06.213789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:06.213789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:06.213789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:06.213789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:06.213789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:06.213789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:06.213789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.213789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:06.214588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.214588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:06.214588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:06.214588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:06.214588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:06.214588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:06.214588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:06.214588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:06.214588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:06.214588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:06.214588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:06.214588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:06.214588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:06.214588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:57:06.214588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:57:06.214588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:06.215434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:06.216467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:06.216467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.216467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:06.409289 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:06.409859 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:06.410801 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:06.411377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.412022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:06.412022 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:06.412022 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:06.412022 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:06.412022 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:06.412022 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:06.412022 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.412022 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:06.412890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.412890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:06.412890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:06.412890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:06.412890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:06.412890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:06.412890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:06.412890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:06.412890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:06.412890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:06.412890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:06.412890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:06.412890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:06.412890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:06.412890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:06.412890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:06.413362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:06.413362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:06.413362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:06.413362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:06.413362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:06.413362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:06.413362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.413362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:06.414118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.414118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:06.414118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:06.414118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:06.414118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:06.414118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:06.414118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:06.414118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:06.414118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:06.414118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:06.414118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:06.414118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:06.414118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:06.414118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:57:06.414118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:57:06.414118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:06.414536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:06.415011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.415011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:06.475337 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:06.476155 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:06.476155 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:06.476155 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:06.476155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.476155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:06.476155 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:06.476155 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:06.476155 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:06.476155 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:06.476155 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:06.476155 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.476155 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:06.480329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.480329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:06.480329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:06.480329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:06.480329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:06.480329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:06.480329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:06.480329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:06.480329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:06.480329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:06.480329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:06.480329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:06.480329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:06.480329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:57:06.480329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:06.480329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:06.480329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:06.481742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:11.039391 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:11.041497 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:11.085877 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:11.086498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.087688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:57:11.087688 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:11.087688 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:11.087688 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:11.087688 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:11.087688 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:11.087688 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.087688 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:11.089377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.089377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:11.089377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:11.089377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:11.089377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:11.089377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:11.089377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:11.089377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:11.089377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:11.089377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:11.089377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:11.089377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:11.089377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:11.089377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:57:11.089377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:11.089377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:11.089377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.089947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:11.124341 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:11.125585 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:11.125927 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:11.126247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.127252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:57:11.127252 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:11.127252 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:11.127252 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:11.127252 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:11.127252 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:11.127252 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.127252 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:11.129001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.129001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:11.129001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:11.129001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:11.129001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:11.129001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:11.129001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:11.129001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:11.129001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:11.129001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:11.129001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:11.129001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:11.129001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:11.129001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:57:11.129001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:11.129001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.129764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:11.209562 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:11.210609 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:57:11.211413 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:11.211910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.212820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:57:11.212820 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:11.212820 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:11.212820 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:11.212820 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:11.212820 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:11.212820 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.212820 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:11.214078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.214078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:11.214078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:11.214078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:11.214078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:11.214078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:11.214078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:11.214078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:11.214078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:11.214078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:11.214078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:11.214078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:11.214078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:11.214078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:11.214078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:11.215205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:11.215205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:11.215205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:11.215205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:11.215205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:11.215205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:11.215205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:11.215205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.215205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:11.215205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.215205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:11.215205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:11.215205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:11.215205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:11.215205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:11.215950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:11.216874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:11.216874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:11.216874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:11.216874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:11.216874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:11.216874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:11.216874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:11.216874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:11.216874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:11.216874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:11.216874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:11.216874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.216874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:11.410151 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:11.410474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:11.411120 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:11.411529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.412342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:11.412342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:11.412342 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:11.412342 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:11.412342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:11.412342 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:11.412342 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.412342 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:11.413504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.413504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:11.413504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:11.413504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:11.413504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:11.413504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:11.413504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:11.413504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:11.413504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:11.413504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:11.413504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:11.413504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:11.413504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:11.413504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:11.413504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:11.413504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:11.414383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:11.414383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:11.414383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:11.414383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:11.414383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:11.414383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:11.414383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.414383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:11.415158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.415158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:11.415158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:11.415158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:11.415158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:11.415158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:11.415158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:11.415158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:11.415158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:11.415158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:11.415158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:11.415158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:11.415158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:11.415158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:57:11.415158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:57:11.415158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:11.415967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:11.417008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.417008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:11.476012 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:11.476704 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:11.477300 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:11.477688 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:11.477949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.478790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:11.478790 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:11.478790 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:11.478790 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:11.478790 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:11.478790 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:11.478790 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.478790 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:11.480595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.480595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:11.480595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:11.480595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:11.480595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:11.480595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:11.480595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:11.480595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:11.480595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:11.480595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:11.480595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:11.480595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:11.480595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:11.480595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:57:11.480595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:11.480595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:11.480595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:11.481345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:16.040279 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:16.042088 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:16.081820 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:16.082139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.083361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:57:16.083361 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:16.083361 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:16.083361 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:16.083361 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:16.083361 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:16.083361 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.083361 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:16.085685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.085685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:16.085685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:16.085685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:16.085685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:16.085685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:16.085685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:16.085685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:16.085685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:16.085685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:16.085685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:16.085685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:16.085685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:16.085685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:57:16.085685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:16.085685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:16.085685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.086833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:16.125354 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:16.126803 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:16.127190 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:16.127442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.128503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:57:16.128503 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:16.128503 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:16.128503 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:16.128503 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:16.128503 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:16.128503 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.128503 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:16.130452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.130452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:16.130452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:16.130452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:16.130452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:16.130452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:16.130452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:16.130452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:16.130452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:16.130452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:16.130452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:16.130452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:16.130452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:16.130452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:57:16.130452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:16.130452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.131030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:16.210462 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:16.211694 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:57:16.212355 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:16.212679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.213778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:57:16.213778 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:16.213778 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:16.213778 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:16.213778 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:16.213778 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:16.213778 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.213778 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:16.215197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.215197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:16.215197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:16.215197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:16.215197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:16.215197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:16.215197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:16.215197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:16.215197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:16.215197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:16.215197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:16.215197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:16.215197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:16.215197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:16.215197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:16.216093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:16.216093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:16.216093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:16.216093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:16.216093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:16.216093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:16.216093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:16.216093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.216093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:16.216949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.216949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:16.216949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:16.216949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:16.216949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:16.216949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:16.216949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:16.216949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:16.216949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:16.216949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:16.216949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:16.216949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:16.216949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:16.216949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:57:16.216949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:57:16.216949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:16.217472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:16.218011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:16.218011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.218011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:16.410941 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:16.411227 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:16.411874 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:16.412225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.412823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:16.412823 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:16.412823 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:16.412823 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:16.412823 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:16.412823 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:16.412823 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.412823 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:16.414182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.414182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:16.414182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:16.414182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:16.414182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:16.414182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:16.414182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:16.414182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:16.414182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:16.414182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:16.414182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:16.414182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:16.414182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:16.414182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:16.414182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:16.414182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:16.415045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:16.415045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:16.415045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:16.415045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:16.415045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:16.415045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:16.415045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.415045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:16.415834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.415834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:16.415834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:16.415834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:16.415834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:16.415834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:16.415834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:16.415834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:16.415834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:16.415834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:16.415834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:16.415834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:16.415834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:16.415834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:57:16.415834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:57:16.415834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:16.416700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:16.417588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.417588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:16.476656 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:16.477399 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:16.478328 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:16.478845 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:16.479212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.480151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:16.480151 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:16.480151 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:16.480151 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:16.480151 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:16.480151 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:16.480151 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.480151 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:16.481651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.481651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:16.481651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:16.481651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:16.481651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:16.481651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:16.481651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:16.481651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:16.481651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:16.481651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:16.481651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:16.481651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:16.481651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:16.481651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:57:16.481651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:16.481651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:16.481651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:16.482467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:21.041044 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:21.043102 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:21.044937 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=240 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:57:21.077762 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:21.078392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.080064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:57:21.080064 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:21.080064 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:21.080064 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:21.080064 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:21.080064 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:21.080064 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.080064 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:21.080868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.080868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:21.080868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:21.080868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:21.080868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:21.080868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:21.080868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:21.080868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:21.080868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:21.080868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:21.080868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:21.080868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:21.080868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:21.080868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:57:21.080868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:21.080868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:21.080868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.082031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:21.126086 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:21.128084 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:21.128513 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:21.128780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.130130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:57:21.130130 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:21.130130 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:21.130130 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:21.130130 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:21.130130 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:21.130130 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.130130 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:21.132226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.132226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:21.132226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:21.132226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:21.132226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:21.132226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:21.132226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:21.132226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:21.132226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:21.132226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:21.132226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:21.132226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:21.132226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:21.132226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:57:21.132226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:21.132226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.132846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:21.211217 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:21.211936 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:57:21.212789 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:21.213089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.213671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:57:21.213671 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:21.213671 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:21.213671 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:21.213671 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:21.213671 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:21.213671 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.213671 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:21.214636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.214636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:21.214636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:21.214636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:21.214636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:21.214636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:21.214636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:21.214636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:21.214636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:21.214636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:21.214636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:21.214636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:21.214636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:21.214636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:21.214636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:21.215475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:21.215475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:21.215475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:21.215475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:21.215475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:21.215475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:21.215475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:21.215475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.215475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:21.215952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.215952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:21.215952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:21.215952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:21.215952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:21.215952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:21.215952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:21.215952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:21.215952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:21.215952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:21.215952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:21.215952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:21.215952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:21.215952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:57:21.215952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:57:21.215952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:21.216775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:21.217831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:21.217831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.217831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:21.411519 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:21.411916 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:21.412977 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:21.413661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.414421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:21.414421 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:21.414421 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:21.414421 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:21.414421 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:21.414421 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:21.414421 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.414421 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:21.415611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.415611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:21.415611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:21.415611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:21.415611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:21.415611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:21.415611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:21.415611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:21.415611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:21.415611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:21.415611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:21.415611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:21.415611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:21.415611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:21.415611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:21.415611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:21.416391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:21.416391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:21.416391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:21.416391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:21.416391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:21.416391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:21.416391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.416391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:21.417890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.417890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:21.417890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:21.417890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:21.417890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:21.417890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:21.417890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:21.417890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:21.417890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:21.417890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:21.417890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:21.417890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:21.417890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:21.417890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:57:21.417890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:57:21.417890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:21.418656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:21.419553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.419553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:21.477467 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:21.477948 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:21.479025 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:21.479635 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:21.479948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.480965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:21.480965 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:21.480965 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:21.480965 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:21.480965 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:21.480965 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:21.480965 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.480965 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:21.483044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.483044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:21.483044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:21.483044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:21.483044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:21.483044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:21.483044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:21.483044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:21.483044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:21.483044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:21.483044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:21.483044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:21.483044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:21.483044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:57:21.483044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:21.483044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:21.483044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:21.483822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:26.041687 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:26.043366 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:26.076443 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:26.076811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.077743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:57:26.077743 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:26.077743 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:26.077743 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:26.077743 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:26.077743 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:26.077743 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.077743 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:26.078616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.078616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:26.078616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:26.078616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:26.078616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:26.078616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:26.078616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:26.078616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:26.078616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:26.078616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:26.078616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:26.078616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:26.078616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:26.078616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:57:26.078616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:26.078616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:26.078616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.079751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:26.126773 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:26.128336 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:26.128654 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:26.128858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.130075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:57:26.130075 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:26.130075 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:26.130075 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:26.130075 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:26.130075 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:26.130075 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.130075 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:26.132520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.132520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:26.132520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:26.132520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:26.132520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:26.132520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:26.132520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:26.132520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:26.132520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:26.132520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:26.132520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:26.132520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:26.132520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:26.132520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:57:26.132520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:26.132520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.134187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:26.211785 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:26.212497 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:57:26.213291 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:26.213741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.214694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:57:26.214694 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:26.214694 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:26.214694 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:26.214694 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:26.214694 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:26.214694 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.214694 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:26.216022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.216022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:26.216022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:26.216022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:26.216022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:26.216022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:26.216022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:26.216022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:26.216022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:26.216022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:26.216022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:26.216022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:26.216022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:26.216022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:26.216022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:26.216742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:26.216742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:26.216742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:26.216742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:26.216742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:26.216742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:26.216742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:26.216742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.216742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:26.217594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.217594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:26.217594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:26.217594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:26.217594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:26.217594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:26.217594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:26.217594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:26.217594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:26.217594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:26.217594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:26.217594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:26.217594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:26.217594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:57:26.217594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:57:26.217594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:26.218337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:26.219236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:26.219236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.219236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:26.412357 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:26.412573 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:26.413409 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:26.413864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.414793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:26.414793 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:26.414793 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:26.414793 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:26.414793 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:26.414793 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:26.414793 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.414793 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:26.416323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.416323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:26.416323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:26.416323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:26.416323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:26.416323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:26.416323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:26.416323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:26.416323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:26.416323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:26.416323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:26.416323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:26.416323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:26.416323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:26.416323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:26.416323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:26.417142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:26.417142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:26.417142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:26.417142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:26.417142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:26.417142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:26.417142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.417142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:26.418482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.418482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:26.418482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:26.418482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:26.418482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:26.418482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:26.418482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:26.418482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:26.418482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:26.418482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:26.418482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:26.418482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:26.418482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:26.418482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:57:26.418482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:57:26.418482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:26.419446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:26.420410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.420410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:26.478153 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:26.478644 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:26.479387 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:26.479782 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:26.480083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.480969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:26.480969 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:26.480969 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:26.480969 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:26.480969 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:26.480969 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:26.480969 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.480969 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:26.482944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.482944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:26.482944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:26.482944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:26.482944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:26.482944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:26.482944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:26.482944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:26.482944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:26.482944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:26.482944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:26.482944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:26.482944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:26.482944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:57:26.482944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:26.482944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:26.482944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:26.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:31.042465 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:31.043680 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:31.079185 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:31.079364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.080333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:57:31.080333 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:31.080333 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:31.080333 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:31.080333 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:31.080333 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:31.080333 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.080333 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:31.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:31.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:31.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:31.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:31.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:31.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:31.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:31.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:31.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:31.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:31.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:31.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:31.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:57:31.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:31.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:31.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.082380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:31.127606 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:31.128827 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:31.129236 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:31.129484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.130536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:57:31.130536 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:31.130536 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:31.130536 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:31.130536 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:31.130536 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:31.130536 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.130536 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:31.132323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.132323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:31.132323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:31.132323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:31.132323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:31.132323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:31.132323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:31.132323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:31.132323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:31.132323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:31.132323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:31.132323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:31.132323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:31.132323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:57:31.132323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:31.132323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.133293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:31.212744 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:31.213371 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:57:31.214019 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:31.214455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.215565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:57:31.215565 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:31.215565 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:31.215565 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:31.215565 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:31.215565 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:31.215565 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.215565 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:31.216919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.216919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:31.216919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:31.216919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:31.216919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:31.216919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:31.216919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:31.216919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:31.216919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:31.216919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:31.216919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:31.216919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:31.216919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:31.216919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:31.216919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:31.217744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:31.217744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:31.217744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:31.217744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:31.217744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:31.217744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:31.217744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:31.217744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.217744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:31.218573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.218573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:31.218573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:31.218573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:31.218573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:31.218573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:31.218573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:31.218573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:31.218573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:31.218573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:31.218573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:31.218573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:31.218573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:31.218573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:57:31.218573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:57:31.218573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:31.219345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:31.220017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:31.220017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.220017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:31.412919 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:31.413481 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:31.413931 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:31.414228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.414780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:31.414780 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:31.414780 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:31.414780 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:31.414780 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:31.414780 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:31.414780 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.414780 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:31.415515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.415515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:31.415515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:31.415515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:31.415515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:31.415515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:31.415515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:31.415515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:31.415515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:31.415515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:31.415515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:31.415515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:31.415515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:31.415515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:31.415515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:31.415515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:31.416239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:31.416239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:31.416239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:31.416239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:31.416239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:31.416239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:31.416239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.416239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:31.416600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.416600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:31.416600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:31.416600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:31.416600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:31.416600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:31.416600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:31.416600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:31.416600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:31.416600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:31.416600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:31.416600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:31.416600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:31.416600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:57:31.416600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:57:31.416600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:31.417476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:31.418054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.418054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:31.478860 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:31.479806 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:31.480773 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:31.481119 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:31.481306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.483109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:31.483109 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:31.483109 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:31.483109 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:31.483109 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:31.483109 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:31.483109 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.483109 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:31.485091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.485091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:31.485091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:31.485091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:31.485091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:31.485091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:31.485091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:31.485091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:31.485091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:31.485091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:31.485091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:31.485091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:31.485091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:31.485091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:57:31.485091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:31.485091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:31.485091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:31.485649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:36.043360 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:36.045345 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:36.107335 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:36.107743 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.108753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:57:36.108753 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:36.108753 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:36.108753 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:36.108753 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:36.108753 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:36.108753 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.108753 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:36.110047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.110047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:36.110047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:36.110047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:36.110047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:36.110047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:36.110047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:36.110047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:36.110047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:36.110047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:36.110047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:36.110047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:36.110047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:36.110047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:57:36.110047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:36.110047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:36.110047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.111447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:36.128313 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:36.129554 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:36.129828 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:36.130172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.131249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:57:36.131249 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:36.131249 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:36.131249 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:36.131249 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:36.131249 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:36.131249 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.131249 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:36.133308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.133308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:36.133308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:36.133308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:36.133308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:36.133308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:36.133308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:36.133308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:36.133308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:36.133308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:36.133308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:36.133308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:36.133308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:36.133308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:57:36.133308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:36.133308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.133901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:36.213526 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:36.213932 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:57:36.214622 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:36.215540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.216018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:57:36.216018 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:36.216018 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:36.216018 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:36.216018 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:36.216018 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:36.216018 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.216018 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:36.217355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.217355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:36.217355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:36.217355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:36.217355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:36.217355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:36.217355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:36.217355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:36.217355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:36.217355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:36.217355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:36.217355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:36.217355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:36.217355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:36.217355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:36.217893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:36.217893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:36.217893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:36.217893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:36.217893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:36.217893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:36.217893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:36.217893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.217893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:36.219025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.219025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:36.219025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:36.219025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:36.219025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:36.219025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:36.219025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:36.219025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:36.219025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:36.219025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:36.219025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:36.219025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:36.219025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:36.219025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:57:36.219025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:57:36.219025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:36.219561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:36.220120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:36.220120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.220120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:36.413852 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:36.414311 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:36.414976 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:36.415435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.416408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:36.416408 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:36.416408 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:36.416408 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:36.416408 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:36.416408 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:36.416408 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.416408 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:36.418131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.418131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:36.418131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:36.418131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:36.418131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:36.418131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:36.418131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:36.418131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:36.418131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:36.418131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:36.418131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:36.418131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:36.418131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:36.418131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:36.418131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:36.418131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:36.418915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:36.418915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:36.418915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:36.418915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:36.418915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:36.418915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:36.418915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.418915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:36.420063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.420063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:36.420063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:36.420063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:36.420063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:36.420063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:36.420063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:36.420063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:36.420063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:36.420063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:36.420063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:36.420063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:36.420063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:36.420063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:57:36.420063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:57:36.420063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:36.420535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:36.421111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.421111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:36.479674 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:36.480200 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:36.480751 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:36.481075 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:36.481287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.481819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:36.481819 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:36.481819 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:36.481819 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:36.481819 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:36.481819 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:36.481819 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.481819 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:36.482814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.482814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:36.482814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:36.482814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:36.482814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:36.482814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:36.482814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:36.482814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:36.482814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:36.482814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:36.482814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:36.482814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:36.482814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:36.482814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:57:36.482814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:36.482814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:36.482814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:36.483749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:41.044103 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:41.045727 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:41.082018 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:41.082589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.083581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:57:41.083581 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:41.083581 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:41.083581 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:41.083581 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:41.083581 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:41.083581 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.083581 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:41.084490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.084490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:41.084490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:41.084490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:41.084490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:41.084490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:41.084490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:41.084490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:41.084490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:41.084490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:41.084490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:41.084490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:41.084490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:41.084490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:57:41.084490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:41.084490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:41.084490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.085863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:41.128815 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:41.130046 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:41.130516 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:41.130832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.131876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:57:41.131876 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:41.131876 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:41.131876 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:41.131876 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:41.131876 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:41.131876 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.131876 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:41.133392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.133392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:41.133392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:41.133392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:41.133392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:41.133392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:41.133392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:41.133392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:41.133392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:41.133392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:41.133392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:41.133392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:41.133392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:41.133392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:57:41.133392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:41.133392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.134601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:41.214171 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:41.214522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:57:41.215316 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:41.215635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.216483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:57:41.216483 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:41.216483 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:41.216483 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:41.216483 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:41.216483 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:41.216483 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.216483 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:41.217765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.217765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:41.217765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:41.217765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:41.217765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:41.217765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:41.217765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:41.217765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:41.217765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:41.217765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:41.217765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:41.217765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:41.217765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:41.217765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:41.217765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:41.218316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:41.218316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:41.218316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:41.218316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:41.218316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:41.218316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:41.218316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:41.218316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.218316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:41.219517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.219517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:41.219517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:41.219517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:41.219517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:41.219517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:41.219517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:41.219517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:41.219517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:41.219517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:41.219517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:41.219517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:41.219517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:41.219517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:57:41.219517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:57:41.219517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:41.219952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:41.220551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:41.220551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.220551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:41.414432 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:41.414913 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:41.415490 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:41.415775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.416346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:41.416346 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:41.416346 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:41.416346 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:41.416346 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:41.416346 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:41.416346 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.416346 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:41.417190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.417190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:41.417190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:41.417190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:41.417190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:41.417190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:41.417190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:41.417190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:41.417190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:41.417190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:41.417190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:41.417190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:41.417190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:41.417190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:41.417190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:41.417190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:41.418036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:41.418036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:41.418036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:41.418036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:41.418036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:41.418036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:41.418036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.418036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:41.418463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.418463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:41.418463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:41.418463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:41.418463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:41.418463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:41.418463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:41.418463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:41.418463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:41.418463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:41.418463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:41.418463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:41.418463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:41.418463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:57:41.418463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:57:41.418463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:41.419302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:41.420188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.420188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:41.480348 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:41.480975 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:41.495550 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:41.495550 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:41.495550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.496504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:41.496504 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:41.496504 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:41.496504 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:41.496504 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:41.496504 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:41.496504 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.496504 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:41.498172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.498172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:41.498172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:41.498172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:41.498172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:41.498172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:41.498172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:41.498172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:41.498172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:41.498172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:41.498172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:41.498172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:41.498172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:41.498172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:57:41.498172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:41.498172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:41.498172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:41.498936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:46.044932 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:46.046626 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:46.081160 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:46.081160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.081679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:57:46.081679 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:46.081679 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:46.081679 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:46.081679 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:46.081679 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:46.081679 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.081679 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:46.082499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.082499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:46.082499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:46.082499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:46.082499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:46.082499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:46.082499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:46.082499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:46.082499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:46.082499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:46.082499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:46.082499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:46.082499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:46.082499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:57:46.082499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:46.082499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:46.082499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.083305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:46.129479 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:46.130583 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:46.130806 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:46.131020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.131685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:57:46.131685 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:46.131685 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:46.131685 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:46.131685 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:46.131685 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:46.131685 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.131685 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:46.132861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.132861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:46.132861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:46.132861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:46.132861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:46.132861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:46.132861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:46.132861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:46.132861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:46.132861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:46.132861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:46.132861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:46.132861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:46.132861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:57:46.132861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:46.132861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.133631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:46.214811 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:46.215334 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:57:46.216201 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:46.216543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.217654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:57:46.217654 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:46.217654 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:46.217654 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:46.217654 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:46.217654 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:46.217654 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.217654 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:46.219013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.219013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:46.219013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:46.219013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:46.219013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:46.219013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:46.219013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:46.219013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:46.219013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:46.219013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:46.219013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:46.219013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:46.219013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:46.219013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:46.219013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:46.219815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:46.219815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:46.219815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:46.219815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:46.219815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:46.219815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:46.219815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:46.219815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.219815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:46.220689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.220689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:46.220689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:46.220689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:46.220689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:46.220689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:46.220689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:46.220689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:46.220689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:46.220689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:46.220689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:46.220689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:46.220689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:46.220689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:57:46.220689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:57:46.220689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:46.221550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:46.222626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:46.222626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.222626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:46.415179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:46.415829 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:46.416510 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:46.416797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.417448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:46.417448 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:46.417448 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:46.417448 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:46.417448 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:46.417448 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:46.417448 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.417448 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:46.418919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.418919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:46.418919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:46.418919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:46.418919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:46.418919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:46.418919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:46.418919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:46.418919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:46.418919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:46.418919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:46.418919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:46.418919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:46.418919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:46.418919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:46.418919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:46.419876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:46.419876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:46.419876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:46.419876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:46.419876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:46.419876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:46.419876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.419876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:46.420953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.420953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:46.420953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:46.420953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:46.420953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:46.420953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:46.420953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:46.420953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:46.420953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:46.420953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:46.420953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:46.420953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:46.420953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:46.420953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:57:46.420953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:57:46.420953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:46.421789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:46.422716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.422716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:46.481004 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:46.481456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:46.482242 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:46.482692 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:46.482942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.483802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:46.483802 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:46.483802 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:46.483802 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:46.483802 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:46.483802 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:46.483802 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.483802 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:46.485075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.485075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:46.485075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:46.485075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:46.485075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:46.485075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:46.485075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:46.485075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:46.485075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:46.485075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:46.485075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:46.485075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:46.485075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:46.485075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:57:46.485075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:46.485075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:46.485075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:46.486113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:51.045709 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:51.047216 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:51.079553 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:51.080127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.080959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:57:51.080959 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:51.080959 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:51.080959 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:51.080959 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:51.080959 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:51.080959 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.080959 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:51.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:51.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:51.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:51.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:51.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:51.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:51.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:51.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:51.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:51.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:51.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:51.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:51.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:57:51.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:51.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:51.081796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.083102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:51.130097 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:51.131021 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:51.131130 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:51.131257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.131740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:57:51.131740 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:51.131740 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:51.131740 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:51.131740 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:51.131740 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:51.131740 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.131740 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:51.132540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.132540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:51.132540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:51.132540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:51.132540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:51.132540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:51.132540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:51.132540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:51.132540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:51.132540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:51.132540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:51.132540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:51.132540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:51.132540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:57:51.132540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:51.132540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.133096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:51.215569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:51.216276 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:57:51.217015 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:51.217278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.217951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:57:51.217951 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:51.217951 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:51.217951 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:51.217951 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:51.217951 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:51.217951 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.217951 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:51.219429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.219429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:51.219429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:51.219429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:51.219429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:51.219429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:51.219429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:51.219429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:51.219429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:51.219429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:51.219429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:51.219429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:51.219429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:51.219429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:51.219429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:51.220251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:51.220251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:51.220251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:51.220251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:51.220251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:51.220251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:51.220251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:51.220251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.220251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:51.221300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.221300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:51.221300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:51.221300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:51.221300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:51.221300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:51.221300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:51.221300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:51.221300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:51.221300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:51.221300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:51.221300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:51.221300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:51.221300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:57:51.221300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:57:51.221300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:51.222135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:51.223006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:51.223006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.223006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:51.416086 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:51.416580 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:51.417265 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:51.417682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.418617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:51.418617 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:51.418617 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:51.418617 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:51.418617 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:51.418617 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:51.418617 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.418617 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:51.419792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.419792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:51.419792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:51.419792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:51.419792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:51.419792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:51.419792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:51.419792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:51.419792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:51.419792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:51.419792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:51.419792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:51.419792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:51.419792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:51.419792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:51.419792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:51.420534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:51.420534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:51.420534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:51.420534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:51.420534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:51.420534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:51.420534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.420534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:51.421598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.421598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:51.421598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:51.421598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:51.421598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:51.421598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:51.421598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:51.421598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:51.421598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:51.421598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:51.421598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:51.421598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:51.421598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:51.421598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:57:51.421598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:57:51.421598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:51.422510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:51.423766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.423766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:51.481644 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:51.482180 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:51.482979 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:51.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:51.483728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.484587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:51.484587 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:51.484587 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:51.484587 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:51.484587 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:51.484587 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:51.484587 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.484587 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:51.486291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.486291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:51.486291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:51.486291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:51.486291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:51.486291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:51.486291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:51.486291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:51.486291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:51.486291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:51.486291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:51.486291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:51.486291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:51.486291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:57:51.486291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:51.486291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:51.486291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:51.486799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:56.046421 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:56.048193 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:56.087314 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:56.087707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.088316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:57:56.088316 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:56.088316 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:56.088316 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:56.088316 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:56.088316 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:56.088316 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.088316 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:56.089468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.089468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:56.089468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:56.089468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:56.089468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:56.089468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:56.089468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:56.089468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:56.089468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:56.089468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:56.089468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:56.089468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:56.089468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:56.089468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:57:56.089468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:56.089468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:56.089468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.090291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:56.130608 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:56.131814 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:56.132250 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:56.132596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.133494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:57:56.133494 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:56.133494 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:56.133494 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:56.133494 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:56.133494 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:56.133494 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.133494 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:56.135209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.135209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:56.135209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:56.135209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:56.135209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:56.135209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:56.135209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:56.135209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:56.135209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:56.135209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:56.135209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:56.135209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:56.135209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:56.135209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:57:56.135209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:56.135209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.136010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:56.216194 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:56.216796 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:57:56.217429 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:56.217787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.218758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:57:56.218758 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:56.218758 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:56.218758 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:56.218758 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:56.218758 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:56.218758 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.218758 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:56.220096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.220096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:56.220096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:56.220096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:56.220096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:56.220096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:56.220096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:56.220096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:56.220096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:56.220096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:56.220096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:56.220096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:56.220096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:56.220096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:56.220096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:56.220427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:56.220427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:56.220427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:56.220427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:56.220427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:56.220427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:56.220427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:56.220427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.220427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:56.221865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.221865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:56.221865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:56.221865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:56.221865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:56.221865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:56.221865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:56.221865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:56.221865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:56.221865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:56.221865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:56.221865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:56.221865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:56.221865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:57:56.221865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:57:56.221865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:56.222664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:56.223765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:56.223765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.223765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:56.416598 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:56.417032 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:56.417396 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:56.417730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.418466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:56.418466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:56.418466 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:56.418466 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:56.418466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:56.418466 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:56.418466 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.418466 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:56.419397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.419397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:57:56.419397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:56.419397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:56.419397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:56.419397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:56.419397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:56.419397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:56.419397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:56.419397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:57:56.419397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:56.419397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:57:56.419397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:56.419397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:57:56.419397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:57:56.419397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:56.419870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:57:56.419870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:56.419870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:57:56.419870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:57:56.419870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:56.419870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:57:56.419870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.419870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:57:56.420724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.420724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:56.420724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:56.420724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:56.420724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:56.420724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:56.420724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:56.420724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:56.420724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:56.420724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:56.420724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:56.420724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:56.420724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:56.420724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:57:56.420724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:57:56.420724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:56.421219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:56.421691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.421691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:57:56.482307 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:57:56.482918 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:57:56.483601 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:56.484040 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:57:56.484280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.485694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:57:56.485694 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:56.485694 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:57:56.485694 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:57:56.485694 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:56.485694 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:57:56.485694 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.485694 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:57:56.487140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.487140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:57:56.487140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:57:56.487140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:57:56.487140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:57:56.487140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:57:56.487140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:56.487140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:57:56.487140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:57:56.487140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:57:56.487140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:57:56.487140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:57:56.487140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:57:56.487140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:57:56.487140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:57:56.487140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:56.487140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:57:56.488047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:01.047276 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:01.048970 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:01.081205 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:01.081449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.082099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:58:01.082099 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:01.082099 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:01.082099 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:01.082099 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:01.082099 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:01.082099 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.082099 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:01.082712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.082712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:01.082712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:01.082712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:01.082712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:01.082712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:01.082712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:01.082712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:01.082712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:01.082712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:01.082712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:01.082712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:01.082712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:01.082712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:58:01.082712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:01.082712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:01.082712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.083349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:01.131364 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:01.132193 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:01.132331 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:01.132426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.132889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:58:01.132889 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:01.132889 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:01.132889 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:01.132889 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:01.132889 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:01.132889 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.132889 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:01.133742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.133742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:01.133742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:01.133742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:01.133742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:01.133742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:01.133742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:01.133742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:01.133742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:01.133742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:01.133742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:01.133742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:01.133742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:01.133742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:58:01.133742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:01.133742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.134599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:01.216861 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:01.217753 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:58:01.218648 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:01.219093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.220113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:58:01.220113 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:01.220113 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:01.220113 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:01.220113 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:01.220113 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:01.220113 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.220113 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:01.221917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.221917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:01.221917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:01.221917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:01.221917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:01.221917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:01.221917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:01.221917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:01.221917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:01.221917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:01.221917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:01.221917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:01.221917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:01.221917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:01.221917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:01.222477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:01.222477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:01.222477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:01.222477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:01.222477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:01.222477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:01.222477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:01.222477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.222477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:01.223301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.223301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:01.223301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:01.223301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:01.223301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:01.223301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:01.223301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:01.223301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:01.223301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:01.223301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:01.223301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:01.223301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:01.223301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:01.223301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:58:01.223301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:58:01.223301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:01.223853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:01.224500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:01.224500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.224500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:01.417283 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:01.417693 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:01.418472 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:01.418883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.419723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:01.419723 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:01.419723 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:01.419723 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:01.419723 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:01.419723 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:01.419723 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.419723 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:01.421148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.421148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:01.421148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:01.421148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:01.421148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:01.421148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:01.421148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:01.421148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:01.421148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:01.421148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:01.421148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:01.421148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:01.421148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:01.421148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:01.421148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:01.421148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:01.421816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:01.421816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:01.421816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:01.421816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:01.421816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:01.421816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:01.421816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.421816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:01.422723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.422723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:01.422723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:01.422723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:01.422723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:01.422723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:01.422723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:01.422723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:01.422723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:01.422723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:01.422723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:01.422723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:01.422723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:01.422723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:58:01.422723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:58:01.422723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:01.423664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:01.424662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.424662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:01.482974 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:01.483295 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:01.484253 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:01.484684 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:01.485640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.485849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:01.485849 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:01.485849 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:01.485849 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:01.485849 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:01.485849 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:01.485849 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.485849 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:01.486945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.486945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:01.486945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:01.486945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:01.486945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:01.486945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:01.486945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:01.486945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:01.486945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:01.486945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:01.486945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:01.486945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:01.486945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:01.486945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:58:01.486945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:01.486945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:01.486945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:01.487819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:06.047785 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:06.049613 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:06.082699 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:06.082894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.083725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:58:06.083725 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:06.083725 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:06.083725 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:06.083725 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:06.083725 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:06.083725 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.083725 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:06.085213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.085213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:06.085213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:06.085213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:06.085213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:06.085213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:06.085213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:06.085213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:06.085213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:06.085213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:06.085213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:06.085213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:06.085213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:06.085213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:58:06.085213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:06.085213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:06.085213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.086814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:06.132064 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:06.133526 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:06.133887 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:06.134240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.135389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:58:06.135389 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:06.135389 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:06.135389 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:06.135389 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:06.135389 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:06.135389 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.135389 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:06.137459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.137459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:06.137459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:06.137459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:06.137459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:06.137459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:06.137459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:06.137459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:06.137459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:06.137459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:06.137459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:06.137459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:06.137459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:06.137459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:58:06.137459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:06.137459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.138329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:06.217555 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:06.218267 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:58:06.218900 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:06.219156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.219850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:58:06.219850 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:06.219850 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:06.219850 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:06.219850 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:06.219850 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:06.219850 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.219850 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:06.220878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.220878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:06.220878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:06.220878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:06.220878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:06.220878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:06.220878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:06.220878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:06.220878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:06.220878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:06.220878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:06.220878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:06.220878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:06.220878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:06.220878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:06.221344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:06.221344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:06.221344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:06.221344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:06.221344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:06.221344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:06.221344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:06.221344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.221344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:06.221980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.221980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:06.221980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:06.221980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:06.221980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:06.221980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:06.221980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:06.221980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:06.221980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:06.221980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:06.221980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:06.221980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:06.221980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:06.221980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:58:06.221980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:58:06.221980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:06.222491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:06.223010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:06.223010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.223010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:06.417635 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:06.418216 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:06.418802 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:06.419096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.419687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:06.419687 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:06.419687 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:06.419687 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:06.419687 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:06.419687 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:06.419687 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.419687 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:06.420853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.420853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:06.420853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:06.420853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:06.420853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:06.420853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:06.420853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:06.420853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:06.420853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:06.420853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:06.420853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:06.420853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:06.420853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:06.420853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:06.420853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:06.420853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:06.421298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:06.421298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:06.421298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:06.421298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:06.421298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:06.421298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:06.421298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.421298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:06.422011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.422011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:06.422011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:06.422011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:06.422011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:06.422011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:06.422011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:06.422011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:06.422011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:06.422011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:06.422011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:06.422011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:06.422011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:06.422011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:58:06.422011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:58:06.422011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:06.422680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:06.423480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.423480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:06.483463 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:06.484018 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:06.484700 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:06.485256 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:06.485579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.486562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:06.486562 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:06.486562 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:06.486562 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:06.486562 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:06.486562 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:06.486562 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.486562 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:06.488458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.488458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:06.488458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:06.488458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:06.488458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:06.488458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:06.488458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:06.488458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:06.488458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:06.488458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:06.488458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:06.488458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:06.488458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:06.488458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:58:06.488458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:06.488458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:06.488458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:06.489291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:11.048493 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:11.049931 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:11.082884 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:11.083572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.084244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:58:11.084244 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:11.084244 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:11.084244 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:11.084244 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:11.084244 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:11.084244 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.084244 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:11.085125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.085125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:11.085125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:11.085125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:11.085125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:11.085125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:11.085125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:11.085125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:11.085125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:11.085125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:11.085125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:11.085125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:11.085125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:11.085125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:58:11.085125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:11.085125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:11.085125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.086091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:11.132766 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:11.134368 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:11.134784 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:11.135068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.136267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:58:11.136267 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:11.136267 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:11.136267 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:11.136267 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:11.136267 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:11.136267 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.136267 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:11.138502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.138502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:11.138502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:11.138502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:11.138502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:11.138502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:11.138502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:11.138502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:11.138502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:11.138502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:11.138502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:11.138502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:11.138502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:11.138502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:58:11.138502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:11.138502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.139326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:11.218647 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:11.219148 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:58:11.220032 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:11.220032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.220619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:58:11.220619 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:11.220619 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:11.220619 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:11.220619 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:11.220619 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:11.220619 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.220619 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:11.221619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.221619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:11.221619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:11.221619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:11.221619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:11.221619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:11.221619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:11.221619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:11.221619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:11.221619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:11.221619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:11.221619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:11.221619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:11.221619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:11.221619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:11.222314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:11.222314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:11.222314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:11.222314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:11.222314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:11.222314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:11.222314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:11.222314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.222314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:11.222952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.222952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:11.222952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:11.222952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:11.222952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:11.222952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:11.222952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:11.222952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:11.222952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:11.222952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:11.222952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:11.222952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:11.222952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:11.222952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:58:11.222952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:58:11.222952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:11.223465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:11.224130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:11.224130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.224130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:11.418509 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:11.419105 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:11.419709 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:11.420160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.420913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:11.420913 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:11.420913 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:11.420913 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:11.420913 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:11.420913 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:11.420913 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.420913 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:11.422161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.422161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:11.422161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:11.422161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:11.422161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:11.422161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:11.422161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:11.422161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:11.422161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:11.422161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:11.422161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:11.422161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:11.422161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:11.422161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:11.422161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:11.422161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:11.423065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:11.423065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:11.423065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:11.423065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:11.423065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:11.423065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:11.423065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.423065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:11.423948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.423948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:11.423948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:11.423948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:11.423948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:11.423948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:11.423948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:11.423948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:11.423948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:11.423948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:11.423948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:11.423948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:11.423948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:11.423948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:58:11.423948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:58:11.423948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:11.424971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:11.425895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.425895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:11.484204 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:11.484760 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:11.485301 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:11.485716 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:11.485967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.486813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:11.486813 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:11.486813 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:11.486813 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:11.486813 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:11.486813 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:11.486813 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.486813 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:11.488826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.488826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:11.488826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:11.488826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:11.488826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:11.488826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:11.488826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:11.488826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:11.488826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:11.488826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:11.488826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:11.488826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:11.488826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:11.488826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:58:11.488826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:11.488826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:11.488826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:11.489645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:16.049057 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:16.050648 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:16.089319 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:16.089717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.090816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:58:16.090816 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:16.090816 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:16.090816 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:16.090816 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:16.090816 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:16.090816 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.090816 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:16.092703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.092703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:16.092703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:16.092703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:16.092703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:16.092703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:16.092703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:16.092703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:16.092703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:16.092703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:16.092703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:16.092703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:16.092703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:16.092703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:58:16.092703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:16.092703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:16.092703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.093803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:16.133259 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:16.134348 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:16.134818 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:16.135161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.136218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:58:16.136218 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:16.136218 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:16.136218 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:16.136218 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:16.136218 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:16.136218 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.136218 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:16.138216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.138216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:16.138216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:16.138216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:16.138216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:16.138216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:16.138216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:16.138216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:16.138216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:16.138216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:16.138216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:16.138216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:16.138216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:16.138216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:58:16.138216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:16.138216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.139087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:16.219329 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:16.219793 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:58:16.220408 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:16.220728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.221673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:58:16.221673 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:16.221673 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:16.221673 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:16.221673 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:16.221673 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:16.221673 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.221673 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:16.223100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.223100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:16.223100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:16.223100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:16.223100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:16.223100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:16.223100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:16.223100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:16.223100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:16.223100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:16.223100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:16.223100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:16.223100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:16.223100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:16.223100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:16.223895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:16.223895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:16.223895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:16.223895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:16.223895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:16.223895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:16.223895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:16.223895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.223895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:16.225170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.225170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:16.225170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:16.225170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:16.225170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:16.225170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:16.225170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:16.225170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:16.225170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:16.225170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:16.225170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:16.225170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:16.225170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:16.225170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:58:16.225170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:58:16.225170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:16.225959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:16.226468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:16.226468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.226468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:16.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:16.419914 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:16.420569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:16.420797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.421498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:16.421498 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:16.421498 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:16.421498 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:16.421498 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:16.421498 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:16.421498 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.421498 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:16.422481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.422481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:16.422481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:16.422481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:16.422481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:16.422481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:16.422481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:16.422481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:16.422481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:16.422481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:16.422481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:16.422481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:16.422481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:16.422481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:16.422481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:16.422481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:16.423503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:16.423503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:16.423503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:16.423503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:16.423503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:16.423503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:16.423503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.423503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:16.424066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.424066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:16.424066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:16.424066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:16.424066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:16.424066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:16.424066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:16.424066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:16.424066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:16.424066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:16.424066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:16.424066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:16.424066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:16.424066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:58:16.424066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:58:16.424066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:16.424804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:16.425698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.425698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:16.484924 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:16.485274 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:16.485821 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:16.486114 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:16.486264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.486888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:16.486888 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:16.486888 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:16.486888 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:16.486888 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:16.486888 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:16.486888 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.486888 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:16.488539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.488539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:16.488539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:16.488539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:16.488539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:16.488539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:16.488539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:16.488539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:16.488539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:16.488539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:16.488539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:16.488539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:16.488539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:16.488539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:58:16.488539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:16.488539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:16.488539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:16.489556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:21.049584 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:21.051293 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:21.052970 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=240 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:58:21.090674 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:21.090674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.091185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:58:21.091185 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:21.091185 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:21.091185 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:21.091185 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:21.091185 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:21.091185 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.091185 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:21.092440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.092440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:21.092440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:21.092440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:21.092440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:21.092440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:21.092440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:21.092440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:21.092440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:21.092440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:21.092440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:21.092440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:21.092440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:21.092440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:58:21.092440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:21.092440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:21.092440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.093573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:21.134138 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:21.136116 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:21.136545 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:21.136815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.138258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:58:21.138258 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:21.138258 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:21.138258 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:21.138258 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:21.138258 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:21.138258 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.138258 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:21.140302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.140302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:21.140302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:21.140302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:21.140302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:21.140302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:21.140302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:21.140302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:21.140302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:21.140302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:21.140302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:21.140302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:21.140302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:21.140302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:58:21.140302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:21.140302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.141115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:21.220141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:21.221116 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:58:21.222302 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:21.222683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.224025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:58:21.224025 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:21.224025 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:21.224025 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:21.224025 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:21.224025 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:21.224025 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.224025 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:21.226021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.226021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:21.226021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:21.226021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:21.226021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:21.226021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:21.226021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:21.226021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:21.226021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:21.226021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:21.226021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:21.226021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:21.226021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:21.226021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:21.226021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:21.227229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:21.227229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:21.227229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:21.227229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:21.227229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:21.227229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:21.227229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:21.227229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.227229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:21.228288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.228288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:21.228288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:21.228288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:21.228288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:21.228288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:21.228288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:21.228288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:21.228288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:21.228288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:21.228288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:21.228288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:21.228288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:21.228288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:58:21.228288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:58:21.228288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:21.228803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:21.229347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:21.229347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.229347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:21.420168 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:21.420706 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:21.421744 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:21.422287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.423365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:21.423365 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:21.423365 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:21.423365 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:21.423365 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:21.423365 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:21.423365 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.423365 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:21.424846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.424846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:21.424846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:21.424846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:21.424846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:21.424846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:21.424846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:21.424846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:21.424846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:21.424846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:21.424846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:21.424846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:21.424846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:21.424846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:21.424846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:21.424846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:21.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:21.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:21.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:21.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:21.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:21.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:21.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:21.426624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.426624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:21.426624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:21.426624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:21.426624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:21.426624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:21.426624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:21.426624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:21.426624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:21.426624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:21.426624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:21.426624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:21.426624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:21.426624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:58:21.426624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:58:21.426624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:21.427424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:21.428265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.428265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:21.485679 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:21.486380 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:21.486966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:21.487415 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:21.487676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.488444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:21.488444 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:21.488444 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:21.488444 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:21.488444 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:21.488444 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:21.488444 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.488444 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:21.489690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.489690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:21.489690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:21.489690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:21.489690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:21.489690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:21.489690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:21.489690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:21.489690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:21.489690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:21.489690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:21.489690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:21.489690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:21.489690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:58:21.489690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:21.489690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:21.489690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:21.490465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:26.050534 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:26.052599 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:26.087791 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:26.088271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.089119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:58:26.089119 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:26.089119 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:26.089119 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:26.089119 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:26.089119 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:26.089119 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.089119 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:26.090208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.090208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:26.090208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:26.090208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:26.090208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:26.090208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:26.090208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:26.090208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:26.090208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:26.090208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:26.090208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:26.090208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:26.090208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:26.090208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:58:26.090208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:26.090208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:26.090208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.090720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:26.135156 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:26.136909 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:26.137369 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:26.137676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.138727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:58:26.138727 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:26.138727 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:26.138727 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:26.138727 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:26.138727 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:26.138727 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.138727 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:26.140870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.140870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:26.140870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:26.140870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:26.140870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:26.140870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:26.140870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:26.140870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:26.140870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:26.140870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:26.140870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:26.140870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:26.140870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:26.140870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:58:26.140870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:26.140870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.142118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:26.220851 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:26.221637 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:58:26.222175 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:26.222492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.223150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:58:26.223150 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:26.223150 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:26.223150 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:26.223150 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:26.223150 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:26.223150 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.223150 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:26.224615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.224615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:26.224615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:26.224615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:26.224615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:26.224615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:26.224615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:26.224615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:26.224615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:26.224615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:26.224615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:26.224615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:26.224615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:26.224615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:26.224615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:26.225552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:26.225552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:26.225552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:26.225552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:26.225552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:26.225552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:26.225552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:26.225552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.225552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:26.226332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.226332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:26.226332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:26.226332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:26.226332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:26.226332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:26.226332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:26.226332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:26.226332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:26.226332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:26.226332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:26.226332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:26.226332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:26.226332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:58:26.226332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:58:26.226332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:26.227331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:26.228331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:26.228331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.228331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:26.421475 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:26.422383 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:26.423093 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:26.423558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.424394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:26.424394 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:26.424394 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:26.424394 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:26.424394 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:26.424394 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:26.424394 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.424394 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:26.425732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.425732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:26.425732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:26.425732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:26.425732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:26.425732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:26.425732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:26.425732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:26.425732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:26.425732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:26.425732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:26.425732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:26.425732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:26.425732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:26.425732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:26.425732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:26.426677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:26.426677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:26.426677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:26.426677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:26.426677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:26.426677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:26.426677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.426677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:26.427482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.427482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:26.427482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:26.427482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:26.427482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:26.427482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:26.427482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:26.427482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:26.427482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:26.427482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:26.427482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:26.427482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:26.427482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:26.427482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:58:26.427482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:58:26.427482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:26.428347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:26.429246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.429246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:26.486561 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:26.487160 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:26.487546 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:26.487792 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:26.487975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.488548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:26.488548 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:26.488548 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:26.488548 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:26.488548 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:26.488548 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:26.488548 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.488548 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:26.489553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.489553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:26.489553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:26.489553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:26.489553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:26.489553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:26.489553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:26.489553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:26.489553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:26.489553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:26.489553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:26.489553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:26.489553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:26.489553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:58:26.489553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:26.489553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:26.489553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:26.490111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:31.051412 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:31.053519 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:31.087913 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:31.088136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.088709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:58:31.088709 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:31.088709 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:31.088709 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:31.088709 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:31.088709 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:31.088709 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.088709 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:31.089739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.089739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:31.089739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:31.089739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:31.089739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:31.089739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:31.089739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:31.089739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:31.089739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:31.089739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:31.089739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:31.089739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:31.089739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:31.089739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:58:31.089739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:31.089739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:31.089739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.090833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:31.136195 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:31.137589 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:31.137943 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:31.138235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.139418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:58:31.139418 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:31.139418 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:31.139418 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:31.139418 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:31.139418 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:31.139418 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.139418 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:31.141243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.141243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:31.141243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:31.141243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:31.141243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:31.141243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:31.141243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:31.141243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:31.141243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:31.141243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:31.141243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:31.141243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:31.141243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:31.141243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:58:31.141243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:31.141243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.141764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:31.221629 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:31.222335 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:58:31.223208 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:31.223583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.224474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:58:31.224474 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:31.224474 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:31.224474 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:31.224474 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:31.224474 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:31.224474 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.224474 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:31.225797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.225797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:31.225797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:31.225797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:31.225797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:31.225797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:31.225797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:31.225797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:31.225797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:31.225797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:31.225797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:31.225797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:31.225797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:31.225797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:31.225797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:31.226664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:31.226664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:31.226664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:31.226664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:31.226664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:31.226664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:31.226664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:31.226664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.226664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:31.227391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.227391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:31.227391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:31.227391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:31.227391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:31.227391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:31.227391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:31.227391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:31.227391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:31.227391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:31.227391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:31.227391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:31.227391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:31.227391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:58:31.227391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:58:31.227391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:31.228015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:31.228555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:31.228555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.228555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:31.422375 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:31.423032 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:31.423635 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:31.424068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.425093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:31.425093 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:31.425093 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:31.425093 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:31.425093 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:31.425093 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:31.425093 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.425093 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:31.426361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.426361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:31.426361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:31.426361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:31.426361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:31.426361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:31.426361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:31.426361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:31.426361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:31.426361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:31.426361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:31.426361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:31.426361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:31.426361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:31.426361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:31.426361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:31.427190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:31.427190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:31.427190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:31.427190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:31.427190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:31.427190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:31.427190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.427190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:31.427897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.427897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:31.427897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:31.427897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:31.427897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:31.427897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:31.427897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:31.427897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:31.427897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:31.427897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:31.427897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:31.427897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:31.427897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:31.427897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:58:31.427897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:58:31.427897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:31.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:31.429319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.429319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:31.487261 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:31.487960 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:31.488540 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:31.488931 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:31.489275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.490263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:31.490263 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:31.490263 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:31.490263 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:31.490263 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:31.490263 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:31.490263 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.490263 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:31.491966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.491966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:31.491966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:31.491966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:31.491966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:31.491966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:31.491966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:31.491966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:31.491966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:31.491966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:31.491966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:31.491966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:31.491966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:31.491966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:58:31.491966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:31.491966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:31.491966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:31.492612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:36.052217 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:36.053884 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:36.090288 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:36.090496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.091248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Traceback (most recent call last):
Apr 07 19:58:36.091248 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:36.091248 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:36.091248 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:36.091248 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:36.091248 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:36.091248 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.091248 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:36.093170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.093170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:36.093170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:36.093170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:36.093170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:36.093170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:36.093170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:36.093170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:36.093170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:36.093170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:36.093170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:36.093170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:36.093170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:36.093170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:58:36.093170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:36.093170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:36.093170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.093760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:36.136925 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:36.138250 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:36.138498 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:36.138719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.139679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:58:36.139679 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:36.139679 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:36.139679 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:36.139679 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:36.139679 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:36.139679 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.139679 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:36.141516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.141516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:36.141516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:36.141516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:36.141516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:36.141516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:36.141516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:36.141516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:36.141516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:36.141516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:36.141516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:36.141516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:36.141516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:36.141516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:58:36.141516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:36.141516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.142356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:36.222377 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:36.222970 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:58:36.223867 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:36.224266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.225172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:58:36.225172 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:36.225172 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:36.225172 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:36.225172 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:36.225172 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:36.225172 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.225172 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:36.226151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.226151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:36.226151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:36.226151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:36.226151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:36.226151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:36.226151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:36.226151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:36.226151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:36.226151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:36.226151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:36.226151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:36.226151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:36.226151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:36.226151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:36.227097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:36.227097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:36.227097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:36.227097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:36.227097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:36.227097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:36.227097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:36.227097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.227097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:36.227575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.227575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:36.227575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:36.227575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:36.227575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:36.227575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:36.227575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:36.227575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:36.227575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:36.227575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:36.227575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:36.227575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:36.227575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:36.227575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:58:36.227575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:58:36.227575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:36.228363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:36.229252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:36.229252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.229252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:36.423134 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:36.423597 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:36.424260 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:36.424649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.425468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:36.425468 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:36.425468 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:36.425468 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:36.425468 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:36.425468 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:36.425468 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.425468 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:36.426813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.426813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:36.426813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:36.426813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:36.426813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:36.426813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:36.426813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:36.426813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:36.426813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:36.426813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:36.426813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:36.426813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:36.426813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:36.426813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:36.426813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:36.426813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:36.427541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:36.427541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:36.427541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:36.427541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:36.427541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:36.427541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:36.427541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.427541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:36.428462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.428462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:36.428462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:36.428462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:36.428462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:36.428462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:36.428462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:36.428462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:36.428462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:36.428462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:36.428462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:36.428462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:36.428462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:36.428462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:58:36.428462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:58:36.428462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:36.429013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:36.429578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.429578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:36.487826 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:36.488295 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:36.489573 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:36.489573 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:36.489573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.490427 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:36.490427 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:36.490427 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:36.490427 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:36.490427 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:36.490427 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:36.490427 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.490427 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:36.492003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.492003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:36.492003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:36.492003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:36.492003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:36.492003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:36.492003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:36.492003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:36.492003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:36.492003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:36.492003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:36.492003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:36.492003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:36.492003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:58:36.492003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:36.492003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:36.492003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:36.492807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:41.053213 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:41.055394 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:41.088958 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:41.089385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.090053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:58:41.090053 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:41.090053 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:41.090053 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:41.090053 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:41.090053 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:41.090053 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.090053 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:41.091176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.091176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:41.091176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:41.091176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:41.091176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:41.091176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:41.091176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:41.091176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:41.091176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:41.091176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:41.091176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:41.091176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:41.091176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:41.091176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:58:41.091176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:41.091176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:41.091176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.092169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:41.137714 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:41.139276 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:41.139556 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:41.139796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.140775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:58:41.140775 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:41.140775 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:41.140775 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:41.140775 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:41.140775 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:41.140775 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.140775 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:41.142564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.142564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:41.142564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:41.142564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:41.142564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:41.142564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:41.142564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:41.142564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:41.142564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:41.142564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:41.142564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:41.142564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:41.142564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:41.142564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:58:41.142564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:41.142564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.143259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:41.223298 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:41.223931 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:58:41.224775 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:41.225119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.225870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:58:41.225870 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:41.225870 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:41.225870 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:41.225870 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:41.225870 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:41.225870 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.225870 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:41.226580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.226580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:41.226580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:41.226580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:41.226580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:41.226580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:41.226580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:41.226580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:41.226580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:41.226580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:41.226580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:41.226580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:41.226580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:41.226580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:41.226580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:41.227415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:41.227415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:41.227415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:41.227415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:41.227415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:41.227415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:41.227415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:41.227415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.227415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:41.227415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.227415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:41.227415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:41.227415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:41.227415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:41.227415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:41.228390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:41.229368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:41.229368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:41.229368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:41.229368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:41.229368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:41.229368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:41.229368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:41.229368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:41.229368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:41.229368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:41.229368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:41.229368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.229368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:41.423971 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:41.424424 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:41.425358 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:41.425722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.426530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:41.426530 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:41.426530 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:41.426530 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:41.426530 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:41.426530 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:41.426530 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.426530 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:41.427792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.427792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:41.427792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:41.427792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:41.427792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:41.427792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:41.427792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:41.427792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:41.427792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:41.427792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:41.427792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:41.427792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:41.427792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:41.427792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:41.427792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:41.427792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:41.428652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:41.428652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:41.428652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:41.428652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:41.428652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:41.428652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:41.428652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.428652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:41.429624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.429624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:41.429624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:41.429624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:41.429624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:41.429624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:41.429624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:41.429624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:41.429624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:41.429624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:41.429624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:41.429624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:41.429624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:41.429624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:58:41.429624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:58:41.429624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:41.430502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:41.431353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.431353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:41.488398 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:41.489286 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:41.489944 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:41.490259 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:41.490700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.491620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:41.491620 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:41.491620 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:41.491620 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:41.491620 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:41.491620 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:41.491620 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.491620 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:41.492962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.492962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:41.492962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:41.492962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:41.492962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:41.492962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:41.492962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:41.492962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:41.492962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:41.492962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:41.492962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:41.492962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:41.492962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:41.492962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:58:41.492962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:41.492962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:41.492962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:41.493513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:46.054588 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:46.057743 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:46.097619 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:46.098555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.099854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Traceback (most recent call last):
Apr 07 19:58:46.099854 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:46.099854 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:46.099854 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:46.099854 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:46.099854 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:46.099854 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.099854 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:46.101270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-75500319-9b55-41fb-99db-9fa916f84fbe None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.101270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:46.101270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:46.101270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:46.101270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:46.101270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:46.101270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:46.101270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:46.101270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:46.101270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:46.101270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:46.101270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:46.101270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:46.101270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:58:46.101270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:46.101270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:46.101270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.102518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:46.138842 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:46.140645 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:46.141050 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:46.141304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.142495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:58:46.142495 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:46.142495 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:46.142495 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:46.142495 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:46.142495 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:46.142495 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.142495 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:46.144369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.144369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:46.144369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:46.144369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:46.144369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:46.144369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:46.144369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:46.144369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:46.144369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:46.144369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:46.144369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:46.144369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:46.144369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:46.144369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:58:46.144369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:46.144369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.145166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:46.224353 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:46.225005 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:58:46.226192 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:46.226578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.227649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:58:46.227649 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:46.227649 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:46.227649 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:46.227649 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:46.227649 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:46.227649 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.227649 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:46.229261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.229261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:46.229261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:46.229261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:46.229261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:46.229261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:46.229261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:46.229261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:46.229261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:46.229261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:46.229261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:46.229261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:46.229261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:46.229261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:46.229261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:46.230173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:46.230173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:46.230173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:46.230173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:46.230173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:46.230173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:46.230173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:46.230173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.230173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:46.231019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.231019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:46.231019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:46.231019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:46.231019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:46.231019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:46.231019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:46.231019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:46.231019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:46.231019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:46.231019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:46.231019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:46.231019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:46.231019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:58:46.231019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:58:46.231019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:46.231839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:46.232707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:46.232707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.232707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:46.425227 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:46.425971 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:46.426831 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:46.427311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.428238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:46.428238 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:46.428238 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:46.428238 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:46.428238 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:46.428238 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:46.428238 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.428238 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:46.429547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.429547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:46.429547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:46.429547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:46.429547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:46.429547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:46.429547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:46.429547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:46.429547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:46.429547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:46.429547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:46.429547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:46.429547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:46.429547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:46.429547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:46.429547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:46.430351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:46.430351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:46.430351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:46.430351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:46.430351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:46.430351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:46.430351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.430351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:46.431311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.431311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:46.431311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:46.431311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:46.431311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:46.431311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:46.431311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:46.431311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:46.431311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:46.431311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:46.431311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:46.431311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:46.431311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:46.431311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:58:46.431311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:58:46.431311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:46.432086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:46.432887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.432887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:46.489516 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:46.490261 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:46.491075 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:46.491495 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:46.491746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.492603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:46.492603 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:46.492603 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:46.492603 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:46.492603 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:46.492603 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:46.492603 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.492603 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:46.493737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.493737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:46.493737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:46.493737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:46.493737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:46.493737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:46.493737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:46.493737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:46.493737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:46.493737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:46.493737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:46.493737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:46.493737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:46.493737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:58:46.493737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:46.493737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:46.493737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:46.494378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:51.055638 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:51.057668 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:51.096731 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:51.097072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.098095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Traceback (most recent call last):
Apr 07 19:58:51.098095 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:51.098095 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:51.098095 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:51.098095 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:51.098095 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:51.098095 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.098095 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:51.098930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.098930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:51.098930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:51.098930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:51.098930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:51.098930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:51.098930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:51.098930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:51.098930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:51.098930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:51.098930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:51.098930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:51.098930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:51.098930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:58:51.098930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:51.098930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:51.098930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.100278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:51.139702 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:51.141235 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:51.141569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:51.141817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.142680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:58:51.142680 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:51.142680 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:51.142680 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:51.142680 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:51.142680 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:51.142680 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.142680 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:51.144832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.144832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:51.144832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:51.144832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:51.144832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:51.144832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:51.144832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:51.144832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:51.144832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:51.144832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:51.144832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:51.144832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:51.144832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:51.144832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:58:51.144832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:51.144832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.145867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:51.225934 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:51.225934 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:58:51.228450 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:51.228816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.230094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:58:51.230094 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:51.230094 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:51.230094 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:51.230094 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:51.230094 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:51.230094 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.230094 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:51.231724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.231724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:51.231724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:51.231724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:51.231724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:51.231724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:51.231724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:51.231724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:51.231724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:51.231724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:51.231724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:51.231724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:51.231724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:51.231724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:51.231724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:51.232388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:51.232388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:51.232388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:51.232388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:51.232388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:51.232388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:51.232388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:51.232388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.232388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:51.234125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.234125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:51.234125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:51.234125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:51.234125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:51.234125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:51.234125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:51.234125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:51.234125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:51.234125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:51.234125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:51.234125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:51.234125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:51.234125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:58:51.234125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:58:51.234125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:51.234697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:51.235354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:51.235354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.235354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:51.426330 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:51.426931 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:51.427902 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:51.428361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.429281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:51.429281 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:51.429281 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:51.429281 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:51.429281 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:51.429281 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:51.429281 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.429281 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:51.430137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.430137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:51.430137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:51.430137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:51.430137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:51.430137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:51.430137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:51.430137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:51.430137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:51.430137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:51.430137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:51.430137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:51.430137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:51.430137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:51.430137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:51.430137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:51.430556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:51.430556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:51.430556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:51.430556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:51.430556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:51.430556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:51.430556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.430556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:51.431160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.431160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:51.431160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:51.431160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:51.431160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:51.431160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:51.431160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:51.431160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:51.431160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:51.431160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:51.431160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:51.431160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:51.431160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:51.431160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:58:51.431160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:58:51.431160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:51.431799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:51.432575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.432575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:51.490633 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:51.491483 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:51.492326 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:51.492753 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:51.492994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.493979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:51.493979 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:51.493979 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:51.493979 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:51.493979 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:51.493979 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:51.493979 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.493979 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:51.496561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.496561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:51.496561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:51.496561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:51.496561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:51.496561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:51.496561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:51.496561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:51.496561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:51.496561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:51.496561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:51.496561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:51.496561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:51.496561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:58:51.496561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:51.496561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:51.496561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:51.497496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:56.056418 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:56.057817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:56.091296 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:56.092412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.097294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Traceback (most recent call last):
Apr 07 19:58:56.097294 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:56.097294 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:56.097294 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:56.097294 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:56.097294 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:56.097294 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.097294 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:56.097806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.097806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:56.097806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:56.097806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:56.097806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:56.097806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:56.097806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:56.097806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:56.097806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:56.097806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:56.097806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:56.097806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:56.097806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:56.097806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:58:56.097806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:56.097806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:56.097806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.098352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:56.140337 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:56.141270 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:56.141589 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:56.141700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.142334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:58:56.142334 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:56.142334 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:56.142334 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:56.142334 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:56.142334 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:56.142334 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.142334 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:56.143204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.143204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:56.143204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:56.143204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:56.143204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:56.143204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:56.143204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:56.143204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:56.143204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:56.143204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:56.143204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:56.143204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:56.143204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:56.143204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:58:56.143204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:56.143204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.144212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:56.225904 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:56.227601 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:58:56.228364 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:56.228617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:56.231592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:56.232399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:56.232399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:56.232399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:56.232399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:56.232399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:56.232399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:56.232399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:56.232399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:56.232399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:56.232399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:56.232399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:56.232399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:56.232399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.232399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:56.232919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.232919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:56.232919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:56.232919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:56.232919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:56.232919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:56.232919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:56.232919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:56.232919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:56.232919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:56.232919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:56.232919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:56.232919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:56.232919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:58:56.232919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:58:56.232919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:56.233528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:56.234161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:56.234161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.234161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:56.427163 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:56.427790 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:56.428885 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:56.429371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.430378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:56.430378 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:56.430378 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:56.430378 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:56.430378 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:56.430378 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:56.430378 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.430378 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:56.431920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.431920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:58:56.431920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:56.431920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:56.431920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:56.431920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:56.431920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:56.431920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:56.431920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:56.431920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:58:56.431920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:56.431920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:58:56.431920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:56.431920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:58:56.431920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:58:56.431920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:56.432686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:58:56.432686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:56.432686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:58:56.432686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:58:56.432686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:56.432686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:58:56.432686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.432686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:58:56.433869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.433869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:56.433869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:56.433869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:56.433869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:56.433869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:56.433869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:56.433869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:56.433869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:56.433869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:56.433869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:56.433869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:56.433869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:56.433869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:58:56.433869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:58:56.433869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:56.434364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:56.434895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.434895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:58:56.491338 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:58:56.492200 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:58:56.492940 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:56.493798 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:58:56.493798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.494715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:58:56.494715 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:56.494715 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:58:56.494715 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:58:56.494715 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:56.494715 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:58:56.494715 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.494715 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:58:56.496663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.496663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:58:56.496663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:58:56.496663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:58:56.496663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:58:56.496663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:58:56.496663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:56.496663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:58:56.496663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:58:56.496663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:58:56.496663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:58:56.496663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:58:56.496663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:58:56.496663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:58:56.496663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:58:56.496663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:56.496663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:58:56.498236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:01.057461 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:01.059529 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eb1e2e67-99c0-4314-9ffb-6a7a73fe70e5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:01.093761 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:01.094203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.095215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eb1e2e67-99c0-4314-9ffb-6a7a73fe70e5 None None] Traceback (most recent call last):
Apr 07 19:59:01.095215 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:01.095215 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:01.095215 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:01.095215 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:01.095215 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:01.095215 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.095215 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:01.096535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-eb1e2e67-99c0-4314-9ffb-6a7a73fe70e5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.096535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:01.096535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:01.096535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:01.096535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:01.096535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:01.096535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:01.096535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:01.096535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:01.096535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:01.096535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:01.096535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:01.096535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:01.096535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:59:01.096535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:01.096535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:01.096535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.097084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:01.141204 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:01.142598 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:01.143002 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:01.143323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.144316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:59:01.144316 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:01.144316 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:01.144316 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:01.144316 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:01.144316 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:01.144316 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.144316 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:01.145868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.145868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:01.145868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:01.145868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:01.145868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:01.145868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:01.145868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:01.145868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:01.145868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:01.145868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:01.145868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:01.145868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:01.145868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:01.145868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:59:01.145868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:01.145868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.146342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:01.227255 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:01.227998 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:59:01.228847 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:01.229207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.230132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:59:01.230132 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:01.230132 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:01.230132 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:01.230132 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:01.230132 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:01.230132 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.230132 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:01.231612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.231612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:01.231612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:01.231612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:01.231612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:01.231612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:01.231612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:01.231612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:01.231612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:01.231612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:01.231612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:01.231612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:01.231612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:01.231612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:01.231612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:01.232054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:01.232054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:01.232054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:01.232054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:01.232054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:01.232054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:01.232054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:01.232054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.232054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:01.233776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.233776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:01.233776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:01.233776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:01.233776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:01.233776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:01.233776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:01.233776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:01.233776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:01.233776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:01.233776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:01.233776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:01.233776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:01.233776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:59:01.233776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:59:01.233776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:01.234246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:01.234767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:01.234767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.234767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:01.427826 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:01.428315 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:01.429007 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:01.429564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.430597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:01.430597 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:01.430597 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:01.430597 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:01.430597 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:01.430597 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:01.430597 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.430597 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:01.432419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.432419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:01.432419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:01.432419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:01.432419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:01.432419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:01.432419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:01.432419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:01.432419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:01.432419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:01.432419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:01.432419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:01.432419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:01.432419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:01.432419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:01.432419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:01.433197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:01.433197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:01.433197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:01.433197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:01.433197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:01.433197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:01.433197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.433197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:01.434343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.434343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:01.434343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:01.434343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:01.434343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:01.434343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:01.434343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:01.434343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:01.434343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:01.434343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:01.434343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:01.434343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:01.434343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:01.434343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:59:01.434343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:59:01.434343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:01.435054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:01.435851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.435851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:01.492110 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:01.493683 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:01.494549 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:01.494890 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:01.495088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.495827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:01.495827 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:01.495827 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:01.495827 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:01.495827 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:01.495827 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:01.495827 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.495827 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:01.497110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.497110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:01.497110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:01.497110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:01.497110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:01.497110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:01.497110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:01.497110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:01.497110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:01.497110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:01.497110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:01.497110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:01.497110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:01.497110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:59:01.497110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:01.497110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:01.497110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:01.497673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:06.058214 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:06.059780 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eb1e2e67-99c0-4314-9ffb-6a7a73fe70e5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:06.099886 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:06.100046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.100600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eb1e2e67-99c0-4314-9ffb-6a7a73fe70e5 None None] Traceback (most recent call last):
Apr 07 19:59:06.100600 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:06.100600 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:06.100600 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:06.100600 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:06.100600 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:06.100600 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.100600 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:06.101492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-eb1e2e67-99c0-4314-9ffb-6a7a73fe70e5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.101492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:06.101492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:06.101492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:06.101492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:06.101492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:06.101492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:06.101492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:06.101492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:06.101492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:06.101492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:06.101492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:06.101492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:06.101492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:59:06.101492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:06.101492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:06.101492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.102299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:06.141870 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:06.143262 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:06.143576 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:06.143856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.144799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:59:06.144799 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:06.144799 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:06.144799 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:06.144799 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:06.144799 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:06.144799 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.144799 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:06.146918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.146918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:06.146918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:06.146918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:06.146918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:06.146918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:06.146918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:06.146918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:06.146918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:06.146918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:06.146918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:06.146918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:06.146918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:06.146918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:59:06.146918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:06.146918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.147778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:06.228184 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:06.228927 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:59:06.229725 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:06.230216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:59:06.231270 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:06.231270 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:06.231270 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:06.231270 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:06.231270 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:06.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.231270 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:06.232683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.232683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:06.232683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:06.232683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:06.232683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:06.232683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:06.232683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:06.232683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:06.232683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:06.232683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:06.232683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:06.232683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:06.232683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:06.232683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:06.232683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:06.234451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:06.234451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:06.234451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:06.234451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:06.234451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:06.234451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:06.234451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:06.234451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.234451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:06.234451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.234451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:06.234451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:06.234451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:06.234451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:06.234451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:06.235473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:06.236443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:06.236443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:06.236443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:06.236443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:06.236443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:06.236443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:06.236443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:06.236443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:06.236443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:06.236443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:06.236443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:06.236443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.236443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:06.428333 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:06.428702 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:06.429381 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:06.429782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.430554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:06.430554 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:06.430554 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:06.430554 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:06.430554 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:06.430554 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:06.430554 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.430554 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:06.431091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.431091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:06.431091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:06.431091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:06.431091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:06.431091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:06.431091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:06.431091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:06.431091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:06.431091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:06.431091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:06.431091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:06.431091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:06.431091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:06.431091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:06.431091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:06.431564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:06.431564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:06.431564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:06.431564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:06.431564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:06.431564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:06.431564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.431564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:06.431827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.431827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:06.431827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:06.431827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:06.431827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:06.431827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:06.431827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:06.431827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:06.431827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:06.431827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:06.431827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:06.431827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:06.431827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:06.431827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:59:06.431827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:59:06.431827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:06.432340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:06.432849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.432849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:06.492913 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:06.493564 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:06.494298 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:06.494676 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:06.494916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.495685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:06.495685 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:06.495685 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:06.495685 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:06.495685 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:06.495685 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:06.495685 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.495685 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:06.497572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.497572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:06.497572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:06.497572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:06.497572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:06.497572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:06.497572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:06.497572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:06.497572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:06.497572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:06.497572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:06.497572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:06.497572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:06.497572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:59:06.497572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:06.497572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:06.497572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:06.498678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:11.058899 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:11.060590 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:11.093228 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:11.093708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.094740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Traceback (most recent call last):
Apr 07 19:59:11.094740 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:11.094740 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:11.094740 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:11.094740 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:11.094740 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:11.094740 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.094740 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:11.096716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.096716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:11.096716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:11.096716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:11.096716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:11.096716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:11.096716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:11.096716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:11.096716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:11.096716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:11.096716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:11.096716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:11.096716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:11.096716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:59:11.096716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:11.096716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:11.096716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.097704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:11.142628 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:11.144139 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:11.144401 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:11.144600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.145519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:59:11.145519 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:11.145519 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:11.145519 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:11.145519 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:11.145519 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:11.145519 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.145519 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:11.147377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.147377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:11.147377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:11.147377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:11.147377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:11.147377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:11.147377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:11.147377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:11.147377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:11.147377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:11.147377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:11.147377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:11.147377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:11.147377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:59:11.147377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:11.147377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.148049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:11.229283 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:11.229869 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:59:11.230679 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:11.231046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.232046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:59:11.232046 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:11.232046 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:11.232046 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:11.232046 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:11.232046 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:11.232046 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.232046 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:11.233445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.233445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:11.233445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:11.233445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:11.233445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:11.233445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:11.233445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:11.233445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:11.233445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:11.233445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:11.233445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:11.233445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:11.233445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:11.233445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:11.233445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:11.233897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:11.233897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:11.233897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:11.233897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:11.233897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:11.233897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:11.233897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:11.233897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.233897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:11.235080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.235080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:11.235080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:11.235080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:11.235080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:11.235080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:11.235080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:11.235080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:11.235080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:11.235080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:11.235080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:11.235080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:11.235080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:11.235080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:59:11.235080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:59:11.235080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:11.235677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:11.236255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:11.236255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.236255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:11.429250 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:11.429614 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:11.430300 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:11.430724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.431572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:11.431572 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:11.431572 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:11.431572 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:11.431572 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:11.431572 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:11.431572 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.431572 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:11.432872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.432872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:11.432872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:11.432872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:11.432872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:11.432872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:11.432872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:11.432872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:11.432872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:11.432872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:11.432872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:11.432872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:11.432872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:11.432872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:11.432872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:11.432872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:11.433872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:11.433872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:11.433872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:11.433872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:11.433872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:11.433872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:11.433872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.433872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:11.434533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.434533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:11.434533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:11.434533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:11.434533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:11.434533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:11.434533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:11.434533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:11.434533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:11.434533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:11.434533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:11.434533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:11.434533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:11.434533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:59:11.434533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:59:11.434533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:11.435409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:11.436474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.436474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:11.493457 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:11.493790 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:11.494153 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:11.494425 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:11.494577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.495289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:11.495289 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:11.495289 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:11.495289 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:11.495289 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:11.495289 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:11.495289 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.495289 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:11.496414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.496414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:11.496414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:11.496414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:11.496414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:11.496414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:11.496414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:11.496414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:11.496414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:11.496414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:11.496414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:11.496414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:11.496414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:11.496414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:59:11.496414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:11.496414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:11.496414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:11.497248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:16.059577 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:16.061583 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:16.093643 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:16.093822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.094615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Traceback (most recent call last):
Apr 07 19:59:16.094615 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:16.094615 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:16.094615 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:16.094615 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:16.094615 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:16.094615 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.094615 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:16.095820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.095820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:16.095820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:16.095820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:16.095820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:16.095820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:16.095820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:16.095820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:16.095820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:16.095820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:16.095820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:16.095820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:16.095820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:16.095820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:59:16.095820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:16.095820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:16.095820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.096717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:16.143404 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:16.145023 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:16.145365 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:16.145699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.146633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:59:16.146633 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:16.146633 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:16.146633 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:16.146633 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:16.146633 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:16.146633 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.146633 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:16.148912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.148912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:16.148912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:16.148912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:16.148912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:16.148912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:16.148912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:16.148912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:16.148912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:16.148912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:16.148912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:16.148912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:16.148912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:16.148912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:59:16.148912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:16.148912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.149955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:16.229912 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:16.230524 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:59:16.230921 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:16.231112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.231890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:59:16.231890 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:16.231890 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:16.231890 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:16.231890 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:16.231890 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:16.231890 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.231890 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:16.233389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.233389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:16.233389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:16.233389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:16.233389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:16.233389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:16.233389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:16.233389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:16.233389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:16.233389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:16.233389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:16.233389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:16.233389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:16.233389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:16.233389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:16.233828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:16.233828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:16.233828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:16.233828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:16.233828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:16.233828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:16.233828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:16.233828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.233828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:16.235324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.235324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:16.235324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:16.235324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:16.235324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:16.235324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:16.235324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:16.235324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:16.235324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:16.235324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:16.235324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:16.235324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:16.235324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:16.235324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:59:16.235324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:59:16.235324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:16.235799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:16.236348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:16.236348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.236348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:16.429766 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:16.430126 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:16.430609 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:16.430864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.431459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:16.431459 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:16.431459 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:16.431459 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:16.431459 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:16.431459 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:16.431459 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.431459 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:16.432805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.432805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:16.432805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:16.432805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:16.432805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:16.432805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:16.432805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:16.432805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:16.432805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:16.432805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:16.432805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:16.432805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:16.432805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:16.432805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:16.432805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:16.432805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:16.433915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:16.433915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:16.433915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:16.433915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:16.433915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:16.433915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:16.433915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.433915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:16.434451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.434451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:16.434451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:16.434451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:16.434451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:16.434451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:16.434451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:16.434451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:16.434451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:16.434451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:16.434451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:16.434451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:16.434451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:16.434451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:59:16.434451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:59:16.434451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:16.435285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:16.436179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.436179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:16.494265 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:16.494764 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:16.495375 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:16.495754 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:16.496009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.496783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:16.496783 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:16.496783 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:16.496783 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:16.496783 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:16.496783 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:16.496783 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.496783 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:16.497962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.497962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:16.497962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:16.497962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:16.497962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:16.497962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:16.497962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:16.497962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:16.497962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:16.497962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:16.497962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:16.497962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:16.497962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:16.497962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:59:16.497962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:16.497962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:16.497962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:16.498907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:21.060363 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:21.061294 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:21.062592 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=240 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 19:59:21.099446 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:21.099920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.101084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Traceback (most recent call last):
Apr 07 19:59:21.101084 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:21.101084 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:21.101084 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:21.101084 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:21.101084 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:21.101084 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.101084 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:21.102334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.102334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:21.102334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:21.102334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:21.102334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:21.102334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:21.102334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:21.102334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:21.102334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:21.102334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:21.102334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:21.102334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:21.102334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:21.102334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:59:21.102334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:21.102334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:21.102334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.103173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:21.144102 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:21.145421 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:21.145800 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:21.146149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.147322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:59:21.147322 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:21.147322 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:21.147322 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:21.147322 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:21.147322 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:21.147322 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.147322 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:21.149031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.149031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:21.149031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:21.149031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:21.149031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:21.149031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:21.149031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:21.149031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:21.149031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:21.149031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:21.149031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:21.149031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:21.149031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:21.149031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:59:21.149031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:21.149031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.150162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:21.230688 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:21.231126 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:59:21.231701 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:21.232152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:59:21.233083 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:21.233083 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:21.233083 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:21.233083 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:21.233083 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:21.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.233083 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:21.233817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.233817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:21.233817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:21.233817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:21.233817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:21.233817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:21.233817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:21.233817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:21.233817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:21.233817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:21.233817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:21.233817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:21.233817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:21.233817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:21.233817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:21.234355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:21.234355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:21.234355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:21.234355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:21.234355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:21.234355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:21.234355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:21.234355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.234355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:21.234775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.234775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:21.234775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:21.234775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:21.234775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:21.234775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:21.234775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:21.234775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:21.234775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:21.234775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:21.234775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:21.234775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:21.234775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:21.234775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:59:21.234775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:59:21.234775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:21.235386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:21.236038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:21.236038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.236038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:21.430413 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:21.430729 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:21.431204 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:21.431615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.432479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:21.432479 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:21.432479 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:21.432479 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:21.432479 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:21.432479 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:21.432479 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.432479 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:21.433836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.433836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:21.433836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:21.433836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:21.433836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:21.433836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:21.433836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:21.433836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:21.433836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:21.433836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:21.433836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:21.433836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:21.433836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:21.433836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:21.433836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:21.433836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:21.434615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:21.434615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:21.434615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:21.434615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:21.434615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:21.434615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:21.434615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.434615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:21.435628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.435628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:21.435628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:21.435628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:21.435628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:21.435628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:21.435628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:21.435628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:21.435628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:21.435628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:21.435628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:21.435628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:21.435628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:21.435628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:59:21.435628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:59:21.435628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:21.436596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:21.437389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.437389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:21.494860 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:21.495613 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:21.496289 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:21.496751 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:21.497093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.497920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:21.497920 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:21.497920 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:21.497920 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:21.497920 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:21.497920 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:21.497920 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.497920 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:21.499179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.499179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:21.499179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:21.499179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:21.499179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:21.499179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:21.499179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:21.499179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:21.499179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:21.499179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:21.499179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:21.499179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:21.499179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:21.499179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:59:21.499179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:21.499179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:21.499179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:21.500138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:26.061049 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:26.062678 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:26.097034 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:26.097364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.098311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Traceback (most recent call last):
Apr 07 19:59:26.098311 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:26.098311 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:26.098311 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:26.098311 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:26.098311 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:26.098311 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.098311 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:26.099556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.099556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:26.099556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:26.099556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:26.099556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:26.099556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:26.099556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:26.099556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:26.099556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:26.099556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:26.099556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:26.099556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:26.099556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:26.099556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:59:26.099556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:26.099556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:26.099556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.101067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:26.144939 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:26.146227 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:26.146479 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:26.146706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.147506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:59:26.147506 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:26.147506 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:26.147506 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:26.147506 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:26.147506 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:26.147506 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.147506 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:26.149596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.149596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:26.149596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:26.149596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:26.149596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:26.149596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:26.149596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:26.149596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:26.149596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:26.149596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:26.149596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:26.149596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:26.149596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:26.149596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:59:26.149596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:26.149596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.150419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:26.231218 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:26.231598 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:59:26.232524 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:26.232836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.233562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:59:26.233562 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:26.233562 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:26.233562 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:26.233562 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:26.233562 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:26.233562 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.233562 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:26.234862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.234862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:26.234862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:26.234862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:26.234862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:26.234862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:26.234862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:26.234862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:26.234862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:26.234862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:26.234862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:26.234862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:26.234862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:26.234862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:26.234862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:26.235905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:26.235905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:26.235905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:26.235905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:26.235905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:26.235905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:26.235905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:26.235905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.235905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:26.236635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.236635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:26.236635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:26.236635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:26.236635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:26.236635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:26.236635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:26.236635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:26.236635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:26.236635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:26.236635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:26.236635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:26.236635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:26.236635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:59:26.236635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:59:26.236635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:26.237440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:26.238296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:26.238296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.238296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:26.431061 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:26.431276 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:26.431936 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:26.432325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.433111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:26.433111 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:26.433111 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:26.433111 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:26.433111 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:26.433111 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:26.433111 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.433111 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:26.434396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.434396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:26.434396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:26.434396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:26.434396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:26.434396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:26.434396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:26.434396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:26.434396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:26.434396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:26.434396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:26.434396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:26.434396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:26.434396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:26.434396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:26.434396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:26.435203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:26.435203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:26.435203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:26.435203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:26.435203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:26.435203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:26.435203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.435203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:26.436074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.436074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:26.436074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:26.436074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:26.436074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:26.436074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:26.436074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:26.436074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:26.436074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:26.436074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:26.436074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:26.436074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:26.436074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:26.436074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:59:26.436074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:59:26.436074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:26.436892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:26.437726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.437726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:26.495730 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:26.496616 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:26.497394 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:26.497793 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:26.498075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.499010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:26.499010 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:26.499010 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:26.499010 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:26.499010 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:26.499010 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:26.499010 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.499010 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:26.500869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.500869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:26.500869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:26.500869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:26.500869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:26.500869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:26.500869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:26.500869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:26.500869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:26.500869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:26.500869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:26.500869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:26.500869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:26.500869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:59:26.500869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:26.500869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:26.500869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:26.502069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:31.061746 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:31.063534 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:31.094348 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:31.094618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.095467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Traceback (most recent call last):
Apr 07 19:59:31.095467 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:31.095467 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:31.095467 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:31.095467 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:31.095467 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:31.095467 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.095467 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:31.096404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.096404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:31.096404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:31.096404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:31.096404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:31.096404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:31.096404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:31.096404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:31.096404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:31.096404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:31.096404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:31.096404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:31.096404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:31.096404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:59:31.096404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:31.096404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:31.096404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.097395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:31.145692 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:31.147141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:31.147507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:31.147847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.148828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:59:31.148828 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:31.148828 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:31.148828 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:31.148828 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:31.148828 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:31.148828 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.148828 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:31.150669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.150669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:31.150669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:31.150669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:31.150669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:31.150669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:31.150669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:31.150669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:31.150669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:31.150669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:31.150669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:31.150669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:31.150669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:31.150669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:59:31.150669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:31.150669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.151536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:31.231777 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:31.232211 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:59:31.232965 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:31.233282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.234103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:59:31.234103 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:31.234103 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:31.234103 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:31.234103 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:31.234103 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:31.234103 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.234103 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:31.236024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.236024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:31.236024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:31.236024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:31.236024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:31.236024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:31.236024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:31.236024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:31.236024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:31.236024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:31.236024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:31.236024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:31.236024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:31.236024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:31.236024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:31.236688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:31.236688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:31.236688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:31.236688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:31.236688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:31.236688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:31.236688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:31.236688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.236688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:31.238202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.238202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:31.238202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:31.238202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:31.238202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:31.238202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:31.238202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:31.238202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:31.238202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:31.238202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:31.238202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:31.238202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:31.238202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:31.238202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:59:31.238202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:59:31.238202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:31.238687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:31.239191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:31.239191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.239191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:31.431659 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:31.432234 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:31.432931 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:31.433360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.434212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:31.434212 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:31.434212 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:31.434212 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:31.434212 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:31.434212 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:31.434212 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.434212 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:31.435553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.435553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:31.435553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:31.435553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:31.435553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:31.435553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:31.435553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:31.435553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:31.435553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:31.435553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:31.435553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:31.435553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:31.435553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:31.435553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:31.435553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:31.435553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:31.436330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:31.436330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:31.436330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:31.436330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:31.436330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:31.436330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:31.436330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.436330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:31.437344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.437344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:31.437344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:31.437344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:31.437344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:31.437344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:31.437344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:31.437344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:31.437344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:31.437344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:31.437344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:31.437344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:31.437344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:31.437344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:59:31.437344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:59:31.437344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:31.438145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:31.438953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.438953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:31.496614 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:31.497232 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:31.498061 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:31.498647 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:31.498880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.499791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:31.499791 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:31.499791 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:31.499791 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:31.499791 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:31.499791 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:31.499791 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.499791 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:31.501626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.501626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:31.501626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:31.501626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:31.501626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:31.501626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:31.501626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:31.501626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:31.501626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:31.501626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:31.501626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:31.501626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:31.501626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:31.501626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:59:31.501626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:31.501626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:31.501626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:31.502516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:36.062739 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:36.064333 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:36.104965 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:36.105582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.106474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Traceback (most recent call last):
Apr 07 19:59:36.106474 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:36.106474 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:36.106474 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:36.106474 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:36.106474 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:36.106474 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.106474 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:36.107481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.107481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:36.107481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:36.107481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:36.107481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:36.107481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:36.107481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:36.107481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:36.107481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:36.107481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:36.107481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:36.107481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:36.107481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:36.107481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:59:36.107481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:36.107481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:36.107481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.108108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:36.146614 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:36.148188 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:36.148646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:36.149003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.150360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:59:36.150360 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:36.150360 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:36.150360 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:36.150360 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:36.150360 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:36.150360 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.150360 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:36.152114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.152114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:36.152114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:36.152114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:36.152114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:36.152114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:36.152114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:36.152114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:36.152114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:36.152114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:36.152114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:36.152114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:36.152114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:36.152114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:59:36.152114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:36.152114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.152871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:36.232773 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:36.233442 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:59:36.234125 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:36.234432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.235379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:59:36.235379 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:36.235379 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:36.235379 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:36.235379 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:36.235379 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:36.235379 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.235379 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:36.236591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.236591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:36.236591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:36.236591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:36.236591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:36.236591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:36.236591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:36.236591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:36.236591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:36.236591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:36.236591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:36.236591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:36.236591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:36.236591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:36.236591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:36.237587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:36.237587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:36.237587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:36.237587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:36.237587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:36.237587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:36.237587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:36.237587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.237587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:36.238117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.238117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:36.238117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:36.238117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:36.238117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:36.238117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:36.238117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:36.238117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:36.238117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:36.238117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:36.238117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:36.238117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:36.238117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:36.238117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:59:36.238117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:59:36.238117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:36.238876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:36.239740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:36.239740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.239740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:36.432620 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:36.433137 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:36.433852 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:36.434329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.435165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:36.435165 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:36.435165 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:36.435165 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:36.435165 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:36.435165 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:36.435165 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.435165 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:36.436126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.436126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:36.436126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:36.436126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:36.436126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:36.436126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:36.436126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:36.436126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:36.436126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:36.436126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:36.436126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:36.436126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:36.436126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:36.436126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:36.436126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:36.436126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:36.437194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:36.437194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:36.437194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:36.437194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:36.437194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:36.437194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:36.437194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.437194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:36.437403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.437403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:36.437403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:36.437403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:36.437403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:36.437403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:36.437403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:36.437403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:36.437403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:36.437403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:36.437403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:36.437403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:36.437403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:36.437403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:59:36.437403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:59:36.437403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:36.437849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:36.438462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.438462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:36.497345 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:36.497782 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:36.498520 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:36.499021 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:36.499339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.500302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:36.500302 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:36.500302 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:36.500302 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:36.500302 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:36.500302 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:36.500302 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.500302 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:36.501416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.501416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:36.501416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:36.501416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:36.501416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:36.501416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:36.501416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:36.501416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:36.501416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:36.501416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:36.501416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:36.501416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:36.501416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:36.501416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:59:36.501416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:36.501416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:36.501416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:36.502273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:41.066219 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:41.066219 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:41.105205 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:41.105609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.106583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Traceback (most recent call last):
Apr 07 19:59:41.106583 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:41.106583 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:41.106583 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:41.106583 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:41.106583 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:41.106583 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.106583 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:41.107810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.107810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:41.107810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:41.107810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:41.107810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:41.107810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:41.107810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:41.107810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:41.107810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:41.107810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:41.107810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:41.107810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:41.107810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:41.107810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:59:41.107810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:41.107810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:41.107810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.108900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:41.147644 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:41.148774 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:41.149143 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:41.149389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.150472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:59:41.150472 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:41.150472 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:41.150472 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:41.150472 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:41.150472 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:41.150472 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.150472 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:41.152845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.152845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:41.152845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:41.152845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:41.152845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:41.152845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:41.152845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:41.152845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:41.152845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:41.152845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:41.152845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:41.152845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:41.152845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:41.152845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:59:41.152845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:41.152845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.153638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:41.233598 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:41.234215 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:59:41.234913 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:41.235230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.236007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:59:41.236007 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:41.236007 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:41.236007 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:41.236007 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:41.236007 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:41.236007 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.236007 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:41.237321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.237321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:41.237321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:41.237321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:41.237321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:41.237321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:41.237321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:41.237321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:41.237321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:41.237321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:41.237321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:41.237321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:41.237321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:41.237321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:41.237321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:41.238030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:41.238030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:41.238030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:41.238030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:41.238030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:41.238030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:41.238030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:41.238030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.238030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:41.238862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.238862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:41.238862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:41.238862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:41.238862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:41.238862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:41.238862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:41.238862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:41.238862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:41.238862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:41.238862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:41.238862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:41.238862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:41.238862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:59:41.238862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:59:41.238862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:41.239615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:41.240373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:41.240373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.240373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:41.433490 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:41.433892 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:41.434652 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:41.435152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.435957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:41.435957 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:41.435957 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:41.435957 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:41.435957 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:41.435957 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:41.435957 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.435957 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:41.437303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.437303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:41.437303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:41.437303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:41.437303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:41.437303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:41.437303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:41.437303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:41.437303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:41.437303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:41.437303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:41.437303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:41.437303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:41.437303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:41.437303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:41.437303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:41.438216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:41.438216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:41.438216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:41.438216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:41.438216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:41.438216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:41.438216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.438216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:41.439162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.439162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:41.439162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:41.439162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:41.439162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:41.439162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:41.439162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:41.439162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:41.439162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:41.439162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:41.439162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:41.439162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:41.439162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:41.439162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:59:41.439162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:59:41.439162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:41.440046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:41.441091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.441091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:41.497955 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:41.498480 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:41.499178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:41.499577 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:41.499801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.500609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:41.500609 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:41.500609 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:41.500609 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:41.500609 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:41.500609 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:41.500609 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.500609 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:41.501742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.501742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:41.501742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:41.501742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:41.501742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:41.501742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:41.501742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:41.501742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:41.501742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:41.501742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:41.501742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:41.501742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:41.501742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:41.501742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:59:41.501742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:41.501742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:41.501742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:41.502858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:46.064088 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:46.065950 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:46.103139 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:46.103542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.104342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Traceback (most recent call last):
Apr 07 19:59:46.104342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:46.104342 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:46.104342 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:46.104342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:46.104342 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:46.104342 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.104342 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:46.105680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.105680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:46.105680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:46.105680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:46.105680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:46.105680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:46.105680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:46.105680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:46.105680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:46.105680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:46.105680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:46.105680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:46.105680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:46.105680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:59:46.105680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:46.105680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:46.105680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.106942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:46.148460 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:46.149740 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:46.149966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:46.150138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.150776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:59:46.150776 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:46.150776 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:46.150776 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:46.150776 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:46.150776 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:46.150776 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.150776 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:46.152015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.152015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:46.152015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:46.152015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:46.152015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:46.152015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:46.152015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:46.152015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:46.152015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:46.152015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:46.152015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:46.152015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:46.152015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:46.152015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:59:46.152015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:46.152015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.152816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:46.234684 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:46.235192 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:59:46.235835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:46.236296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.237194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:59:46.237194 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:46.237194 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:46.237194 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:46.237194 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:46.237194 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:46.237194 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.237194 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:46.238028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.238028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:46.238028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:46.238028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:46.238028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:46.238028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:46.238028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:46.238028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:46.238028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:46.238028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:46.238028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:46.238028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:46.238028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:46.238028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:46.238028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:46.238798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:46.238798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:46.238798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:46.238798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:46.238798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:46.238798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:46.238798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:46.238798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.238798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:46.239809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.239809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:46.239809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:46.239809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:46.239809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:46.239809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:46.239809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:46.239809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:46.239809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:46.239809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:46.239809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:46.239809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:46.239809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:46.239809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:59:46.239809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:59:46.239809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:46.240337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:46.240821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:46.240821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.240821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:46.434509 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:46.435350 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:46.436315 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:46.436761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.437688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:46.437688 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:46.437688 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:46.437688 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:46.437688 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:46.437688 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:46.437688 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.437688 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:46.439013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.439013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:46.439013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:46.439013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:46.439013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:46.439013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:46.439013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:46.439013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:46.439013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:46.439013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:46.439013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:46.439013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:46.439013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:46.439013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:46.439013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:46.439013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:46.439828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:46.439828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:46.439828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:46.439828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:46.439828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:46.439828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:46.439828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.439828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:46.440737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.440737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:46.440737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:46.440737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:46.440737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:46.440737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:46.440737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:46.440737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:46.440737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:46.440737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:46.440737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:46.440737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:46.440737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:46.440737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:59:46.440737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:59:46.440737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:46.441611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:46.442490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.442490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:46.498918 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:46.499870 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:46.500711 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:46.501165 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:46.501343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.502368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:46.502368 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:46.502368 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:46.502368 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:46.502368 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:46.502368 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:46.502368 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.502368 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:46.505757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.505757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:46.505757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:46.505757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:46.505757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:46.505757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:46.505757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:46.505757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:46.505757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:46.505757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:46.505757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:46.505757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:46.505757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:46.505757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:59:46.505757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:46.505757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:46.505757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:46.506464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:51.064820 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:51.066074 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:51.102274 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:51.102679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.103613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Traceback (most recent call last):
Apr 07 19:59:51.103613 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:51.103613 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:51.103613 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:51.103613 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:51.103613 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:51.103613 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.103613 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:51.104558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.104558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:51.104558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:51.104558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:51.104558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:51.104558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:51.104558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:51.104558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:51.104558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:51.104558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:51.104558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:51.104558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:51.104558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:51.104558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:59:51.104558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:51.104558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:51.104558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.105104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:51.149124 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:51.150267 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:51.150585 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:51.150816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.151662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:59:51.151662 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:51.151662 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:51.151662 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:51.151662 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:51.151662 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:51.151662 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.151662 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:51.153139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.153139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:51.153139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:51.153139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:51.153139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:51.153139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:51.153139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:51.153139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:51.153139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:51.153139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:51.153139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:51.153139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:51.153139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:51.153139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:59:51.153139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:51.153139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.154606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:51.235449 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:51.236215 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:59:51.236942 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:51.237286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.238158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:59:51.238158 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:51.238158 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:51.238158 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:51.238158 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:51.238158 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:51.238158 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.238158 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:51.239697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.239697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:51.239697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:51.239697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:51.239697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:51.239697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:51.239697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:51.239697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:51.239697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:51.239697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:51.239697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:51.239697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:51.239697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:51.239697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:51.239697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:51.240452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:51.240452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:51.240452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:51.240452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:51.240452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:51.240452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:51.240452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:51.240452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.240452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:51.241545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.241545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:51.241545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:51.241545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:51.241545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:51.241545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:51.241545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:51.241545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:51.241545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:51.241545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:51.241545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:51.241545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:51.241545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:51.241545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:59:51.241545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:59:51.241545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:51.242351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:51.243148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:51.243148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.243148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:51.435416 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:51.435874 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:51.436459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:51.436835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.437623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:51.437623 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:51.437623 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:51.437623 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:51.437623 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:51.437623 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:51.437623 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.437623 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:51.438922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.438922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:51.438922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:51.438922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:51.438922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:51.438922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:51.438922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:51.438922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:51.438922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:51.438922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:51.438922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:51.438922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:51.438922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:51.438922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:51.438922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:51.438922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:51.439824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:51.439824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:51.439824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:51.439824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:51.439824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:51.439824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:51.439824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.439824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:51.440363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.440363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:51.440363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:51.440363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:51.440363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:51.440363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:51.440363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:51.440363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:51.440363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:51.440363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:51.440363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:51.440363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:51.440363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:51.440363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:59:51.440363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:59:51.440363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:51.441152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:51.442020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.442020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:51.499598 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:51.500238 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:51.500772 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:51.501227 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:51.501436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.501966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:51.501966 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:51.501966 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:51.501966 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:51.501966 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:51.501966 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:51.501966 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.501966 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:51.503046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.503046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:51.503046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:51.503046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:51.503046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:51.503046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:51.503046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:51.503046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:51.503046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:51.503046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:51.503046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:51.503046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:51.503046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:51.503046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:59:51.503046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:51.503046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:51.503046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:51.503523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:56.065583 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:56.067486 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:56.103953 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:56.104612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.105679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Traceback (most recent call last):
Apr 07 19:59:56.105679 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:56.105679 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:56.105679 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:56.105679 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:56.105679 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:56.105679 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.105679 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:56.106931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.106931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:56.106931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:56.106931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:56.106931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:56.106931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:56.106931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:56.106931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:56.106931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:56.106931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:56.106931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:56.106931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:56.106931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:56.106931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 19:59:56.106931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:56.106931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:56.106931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.107791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:56.149633 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:56.150676 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:56.151053 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:56.151264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.152384 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 19:59:56.152384 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:56.152384 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:56.152384 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:56.152384 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:56.152384 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:56.152384 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.152384 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:56.154478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.154478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:56.154478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:56.154478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:56.154478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:56.154478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:56.154478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:56.154478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:56.154478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:56.154478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:56.154478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:56.154478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:56.154478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:56.154478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 19:59:56.154478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:56.154478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.155464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:56.236229 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:56.236860 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 19:59:56.237473 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:56.237862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.238811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 19:59:56.238811 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:56.238811 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:56.238811 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:56.238811 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:56.238811 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:56.238811 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.238811 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:56.239839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.239839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:56.239839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:56.239839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:56.239839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:56.239839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:56.239839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:56.239839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:56.239839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:56.239839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:56.239839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:56.239839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:56.239839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:56.239839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:56.239839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:56.240932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:56.240932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:56.240932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:56.240932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:56.240932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:56.240932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:56.240932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:56.240932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.240932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:56.240932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.240932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:56.240932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:56.240932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:56.240932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:56.240932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:56.242426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:56.243723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:56.243723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:56.243723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:56.243723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:56.243723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:56.243723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:56.243723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:56.243723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:56.243723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:56.243723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:56.243723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:56.243723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.243723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:56.436326 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:56.436674 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:56.437269 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:56.437708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.438562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:56.438562 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:56.438562 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:56.438562 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:56.438562 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:56.438562 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:56.438562 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.438562 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:56.439939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.439939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 19:59:56.439939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:56.439939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:56.439939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:56.439939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:56.439939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:56.439939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:56.439939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:56.439939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 19:59:56.439939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:56.439939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 19:59:56.439939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:56.439939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 19:59:56.439939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 19:59:56.439939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:56.440785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 19:59:56.440785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:56.440785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 19:59:56.440785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 19:59:56.440785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:56.440785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 19:59:56.440785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.440785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 19:59:56.441727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.441727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:56.441727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:56.441727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:56.441727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:56.441727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:56.441727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:56.441727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:56.441727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:56.441727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:56.441727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:56.441727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:56.441727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:56.441727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 19:59:56.441727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 19:59:56.441727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:56.442667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:56.443547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.443547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 19:59:56.500226 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 19:59:56.500593 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 19:59:56.501122 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:56.501600 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 19:59:56.501852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.502732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 19:59:56.502732 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:56.502732 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 19:59:56.502732 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 19:59:56.502732 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:56.502732 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 19:59:56.502732 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.502732 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 19:59:56.504676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.504676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 19:59:56.504676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 19:59:56.504676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 19:59:56.504676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 19:59:56.504676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 19:59:56.504676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:56.504676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 19:59:56.504676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 19:59:56.504676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 19:59:56.504676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 19:59:56.504676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 19:59:56.504676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 19:59:56.504676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 19:59:56.504676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 19:59:56.504676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:56.504676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 19:59:56.505471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:01.066134 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:01.067271 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:01.101322 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:01.101597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.102348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Traceback (most recent call last):
Apr 07 20:00:01.102348 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:01.102348 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:01.102348 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:01.102348 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:01.102348 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:01.102348 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.102348 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:01.103567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.103567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:01.103567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:01.103567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:01.103567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:01.103567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:01.103567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:01.103567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:01.103567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:01.103567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:01.103567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:01.103567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:01.103567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:01.103567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:00:01.103567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:01.103567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:01.103567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.104112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:01.150252 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:01.151456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:01.151723 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:01.151970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.152832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 20:00:01.152832 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:01.152832 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:01.152832 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:01.152832 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:01.152832 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:01.152832 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.152832 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:01.154369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.154369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:01.154369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:01.154369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:01.154369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:01.154369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:01.154369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:01.154369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:01.154369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:01.154369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:01.154369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:01.154369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:01.154369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:01.154369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:00:01.154369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:01.154369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.155934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:01.236925 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:01.237319 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:00:01.237943 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:01.238276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.239023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 20:00:01.239023 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:01.239023 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:01.239023 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:01.239023 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:01.239023 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:01.239023 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.239023 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:01.239695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.239695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:01.239695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:01.239695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:01.239695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:01.239695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:01.239695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:01.239695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:01.239695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:01.239695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:01.239695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:01.239695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:01.239695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:01.239695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:01.239695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:01.240513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:01.240513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:01.240513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:01.240513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:01.240513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:01.240513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:01.240513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:01.240513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.240513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:01.240513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.240513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:01.240513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:01.240513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:01.240513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:01.240513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:01.241278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:01.242127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:01.242127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:01.242127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:01.242127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:01.242127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:01.242127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:01.242127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:01.242127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:01.242127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:01.242127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:01.242127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:01.242127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.242127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:01.436547 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:01.436887 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:01.437395 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:01.437679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.438258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:01.438258 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:01.438258 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:01.438258 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:01.438258 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:01.438258 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:01.438258 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.438258 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:01.438994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.438994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:01.438994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:01.438994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:01.438994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:01.438994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:01.438994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:01.438994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:01.438994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:01.438994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:01.438994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:01.438994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:01.438994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:01.438994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:01.438994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:01.438994 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:01.439507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:01.439507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:01.439507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:01.439507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:01.439507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:01.439507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:01.439507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.439507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:01.439997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.439997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:01.439997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:01.439997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:01.439997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:01.439997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:01.439997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:01.439997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:01.439997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:01.439997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:01.439997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:01.439997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:01.439997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:01.439997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:00:01.439997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:00:01.439997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:01.440471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:01.441033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.441033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:01.500745 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:01.501526 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:01.502158 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:01.502562 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:01.502797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.503614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:01.503614 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:01.503614 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:01.503614 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:01.503614 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:01.503614 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:01.503614 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.503614 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:01.505759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.505759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:01.505759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:01.505759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:01.505759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:01.505759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:01.505759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:01.505759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:01.505759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:01.505759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:01.505759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:01.505759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:01.505759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:01.505759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:00:01.505759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:01.505759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:01.505759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:01.506235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:06.066846 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:06.068913 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:06.104415 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:06.105007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.105910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Traceback (most recent call last):
Apr 07 20:00:06.105910 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:06.105910 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:06.105910 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:06.105910 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:06.105910 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:06.105910 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.105910 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:06.106793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.106793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:06.106793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:06.106793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:06.106793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:06.106793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:06.106793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:06.106793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:06.106793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:06.106793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:06.106793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:06.106793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:06.106793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:06.106793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:00:06.106793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:06.106793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:06.106793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.107656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:06.151027 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:06.152527 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:06.152801 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:06.153090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.154007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 20:00:06.154007 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:06.154007 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:06.154007 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:06.154007 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:06.154007 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:06.154007 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.154007 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:06.155668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.155668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:06.155668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:06.155668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:06.155668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:06.155668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:06.155668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:06.155668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:06.155668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:06.155668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:06.155668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:06.155668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:06.155668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:06.155668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:00:06.155668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:06.155668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.156551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:06.237422 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:06.238488 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:00:06.238849 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:06.239479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.240097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 20:00:06.240097 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:06.240097 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:06.240097 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:06.240097 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:06.240097 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:06.240097 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.240097 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:06.240614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.240614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:06.240614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:06.240614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:06.240614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:06.240614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:06.240614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:06.240614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:06.240614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:06.240614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:06.240614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:06.240614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:06.240614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:06.240614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:06.240614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:06.241725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:06.241725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:06.241725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:06.241725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:06.241725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:06.241725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:06.241725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:06.241725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.241725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:06.241725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.241725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:06.241725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:06.241725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:06.241725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:06.241725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:06.242472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:06.243351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:06.243351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:06.243351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:06.243351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:06.243351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:06.243351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:06.243351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:06.243351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:06.243351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:06.243351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:06.243351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:06.243351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.243351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:06.437215 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:06.437814 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:06.438642 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:06.439158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.439972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:06.439972 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:06.439972 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:06.439972 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:06.439972 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:06.439972 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:06.439972 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.439972 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:06.441373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.441373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:06.441373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:06.441373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:06.441373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:06.441373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:06.441373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:06.441373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:06.441373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:06.441373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:06.441373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:06.441373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:06.441373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:06.441373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:06.441373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:06.441373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:06.442141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:06.442141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:06.442141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:06.442141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:06.442141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:06.442141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:06.442141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.442141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:06.442948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.442948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:06.442948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:06.442948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:06.442948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:06.442948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:06.442948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:06.442948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:06.442948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:06.442948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:06.442948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:06.442948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:06.442948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:06.442948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:00:06.442948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:00:06.442948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:06.443696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:06.445293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.445293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:06.501566 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:06.502096 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:06.502690 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:06.503006 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:06.503203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.503815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:06.503815 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:06.503815 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:06.503815 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:06.503815 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:06.503815 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:06.503815 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.503815 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:06.505679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.505679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:06.505679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:06.505679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:06.505679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:06.505679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:06.505679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:06.505679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:06.505679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:06.505679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:06.505679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:06.505679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:06.505679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:06.505679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:00:06.505679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:06.505679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:06.505679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:06.506702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:11.067561 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:11.068829 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:11.104776 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:11.104977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.105640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Traceback (most recent call last):
Apr 07 20:00:11.105640 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:11.105640 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:11.105640 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:11.105640 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:11.105640 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:11.105640 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.105640 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:11.106836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.106836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:11.106836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:11.106836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:11.106836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:11.106836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:11.106836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:11.106836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:11.106836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:11.106836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:11.106836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:11.106836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:11.106836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:11.106836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:00:11.106836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:11.106836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:11.106836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.107525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:11.151863 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:11.153289 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:11.153643 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:11.153998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.155169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 20:00:11.155169 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:11.155169 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:11.155169 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:11.155169 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:11.155169 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:11.155169 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.155169 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:11.157141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.157141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:11.157141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:11.157141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:11.157141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:11.157141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:11.157141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:11.157141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:11.157141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:11.157141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:11.157141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:11.157141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:11.157141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:11.157141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:00:11.157141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:11.157141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.157975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:11.238322 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:11.238967 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:00:11.239617 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:11.239848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.240709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 20:00:11.240709 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:11.240709 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:11.240709 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:11.240709 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:11.240709 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:11.240709 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.240709 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:11.241658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.241658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:11.241658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:11.241658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:11.241658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:11.241658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:11.241658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:11.241658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:11.241658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:11.241658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:11.241658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:11.241658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:11.241658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:11.241658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:11.241658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:11.242190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:11.242190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:11.242190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:11.242190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:11.242190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:11.242190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:11.242190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:11.242190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.242190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:11.242639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.242639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:11.242639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:11.242639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:11.242639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:11.242639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:11.242639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:11.242639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:11.242639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:11.242639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:11.242639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:11.242639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:11.242639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:11.242639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:00:11.242639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:00:11.242639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:11.243388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:11.244201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:11.244201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.244201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:11.437944 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:11.438381 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:11.439263 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:11.439691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.440552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:11.440552 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:11.440552 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:11.440552 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:11.440552 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:11.440552 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:11.440552 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.440552 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:11.441808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.441808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:11.441808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:11.441808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:11.441808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:11.441808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:11.441808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:11.441808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:11.441808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:11.441808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:11.441808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:11.441808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:11.441808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:11.441808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:11.441808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:11.441808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:11.442620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:11.442620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:11.442620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:11.442620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:11.442620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:11.442620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:11.442620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.442620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:11.443385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.443385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:11.443385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:11.443385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:11.443385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:11.443385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:11.443385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:11.443385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:11.443385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:11.443385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:11.443385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:11.443385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:11.443385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:11.443385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:00:11.443385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:00:11.443385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:11.444236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:11.445095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.445095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:11.502199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:11.502639 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:11.503393 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:11.503847 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:11.504143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.505090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:11.505090 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:11.505090 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:11.505090 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:11.505090 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:11.505090 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:11.505090 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.505090 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:11.506722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.506722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:11.506722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:11.506722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:11.506722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:11.506722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:11.506722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:11.506722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:11.506722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:11.506722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:11.506722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:11.506722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:11.506722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:11.506722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:00:11.506722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:11.506722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:11.506722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:11.507286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:15.796897 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:15.808807 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 07 20:00:15.809006 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=104575) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 07 20:00:15.809109 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Maintenance task: Fixing resource bfbf6c8f-1f7e-474c-a618-4e99355c0282 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:00:15.853605 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, resource={'id': 'bfbf6c8f-1f7e-474c-a618-4e99355c0282', 'name': 'private', 'tenant_id': '47ea4a7c5a154b528631c5537cfdb850', 'project_id': '47ea4a7c5a154b528631c5537cfdb850', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['49f10797-7993-4eac-ad9c-5db13bcf3a17', 'bdd6f685-b77d-459b-b386-e3ef09898997'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:35:01Z', 'updated_at': '2026-04-07T19:35:05Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39614}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:15.853953 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:15.854649 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-ca0b7fb0-3499-4804-b894-4bb867203f37, external_ids_update=None, columns={'tag': 39614}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:15.854649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:15.855199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:00:15.855199 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:15.855199 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:15.855199 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:15.855199 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:15.855199 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:15.855199 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:15.855199 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:15.856748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Maintenance task: Failed to fix resource bfbf6c8f-1f7e-474c-a618-4e99355c0282 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:15.856748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:00:15.856748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:00:15.856748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:00:15.856748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:00:15.856748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:00:15.856748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 20:00:15.856748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:15.856748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:15.856748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:00:15.856748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:15.857359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:15.857359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:15.857359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:00:15.857359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:15.857359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:00:15.857359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:15.857359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:00:15.857359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:00:15.857359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:15.857359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:00:15.857359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:15.857359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:00:15.857359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:00:15.857359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:15.857840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:00:15.857840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:15.857840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:00:15.857840 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Maintenance task: Fixing resource 92857a9a-261a-45c8-bdf2-793e5d5977e1 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:00:15.886709 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, resource={'id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'name': 'public', 'tenant_id': '47ea4a7c5a154b528631c5537cfdb850', 'project_id': '47ea4a7c5a154b528631c5537cfdb850', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['158905cc-b5be-42da-8777-3d7ded042b7c', '6de186a3-9e7c-4950-a1c6-817a37a68984'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-07T19:35:09Z', 'updated_at': '2026-04-07T19:35:17Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:15.886945 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:15.887222 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-783e27a6-53d0-42e0-a778-7125c7a0cff1, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:15.887388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:15.888002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:00:15.888002 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:15.888002 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:15.888002 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:15.888002 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:15.888002 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:15.888002 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:15.888002 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:15.889000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Maintenance task: Failed to fix resource 92857a9a-261a-45c8-bdf2-793e5d5977e1 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:15.889000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:00:15.889000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:00:15.889000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:00:15.889000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:00:15.889000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:00:15.889000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 20:00:15.889000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:15.889000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:15.889000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:00:15.889000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:15.889378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:15.889378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:15.889378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:00:15.889378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:15.889378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:00:15.889378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:15.889378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:00:15.889378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:00:15.889378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:15.889378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:00:15.889378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:15.889378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:00:15.889378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:00:15.889378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:15.889758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:00:15.889758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:15.889758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:00:15.889758 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Maintenance task: Fixing resource 246975ba-4717-4c89-a181-15f0da115b38 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:00:15.915924 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-246975ba-4717-4c89-a181-15f0da115b38, resource={'id': '246975ba-4717-4c89-a181-15f0da115b38', 'name': 'admin_net', 'tenant_id': 'c55e43aaf6164fb7ba8075ffd24bc8d2', 'project_id': 'c55e43aaf6164fb7ba8075ffd24bc8d2', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['4b75275b-2834-446a-a1bf-6e510e154273'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:40:24Z', 'updated_at': '2026-04-07T19:40:25Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 64449}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:15.916343 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-246975ba-4717-4c89-a181-15f0da115b38, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:15.916853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-f0065b7a-ceb5-4313-9c13-1796e417df18, external_ids_update=None, columns={'tag': 64449}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:15.917057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:15.918004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:00:15.918004 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:15.918004 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:15.918004 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:15.918004 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:15.918004 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:15.918004 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:15.918004 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:15.919140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Maintenance task: Failed to fix resource 246975ba-4717-4c89-a181-15f0da115b38 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:15.919140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:00:15.919140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:00:15.919140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:00:15.919140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:00:15.919140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:00:15.919140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 20:00:15.919140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:15.919140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:15.919140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:00:15.919140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:15.919561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:15.919561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:15.919561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:00:15.919561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:15.919561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:00:15.919561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:15.919561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:00:15.919561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:00:15.919561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:15.919561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:00:15.919561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:15.919561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:00:15.919561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:00:15.919561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:15.919909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:00:15.919909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:15.919909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:00:15.919909 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Maintenance task: Fixing resource 40ad0605-2aac-4da1-b108-03821a0aa715 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:00:15.951545 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-40ad0605-2aac-4da1-b108-03821a0aa715, resource={'id': '40ad0605-2aac-4da1-b108-03821a0aa715', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'tenant_id': '7e48d42664ae4580840a2aef59d52e53', 'project_id': '7e48d42664ae4580840a2aef59d52e53', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['afc68917-6901-4e08-99ad-5c3d8bb8a584'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:41:05Z', 'updated_at': '2026-04-07T19:41:05Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 12961}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:15.951906 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-40ad0605-2aac-4da1-b108-03821a0aa715, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:15.952199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-7853e8c0-165f-48a8-8e65-36b87d07f16a, external_ids_update=None, columns={'tag': 12961}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:15.952318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:15.953028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:00:15.953028 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:15.953028 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:15.953028 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:15.953028 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:15.953028 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:15.953028 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:15.953028 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:15.954463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Maintenance task: Failed to fix resource 40ad0605-2aac-4da1-b108-03821a0aa715 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:15.954463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:00:15.954463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:00:15.954463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:00:15.954463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:00:15.954463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:00:15.954463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 20:00:15.954463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:15.954463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:15.954463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:00:15.954463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:15.955057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:15.955057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:15.955057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:00:15.955057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:15.955057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:00:15.955057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:15.955057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:00:15.955057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:00:15.955057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:15.955057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:00:15.955057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:15.955057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:00:15.955057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:00:15.955057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:15.955451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:00:15.955451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:15.955451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:00:15.955451 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Maintenance task: Fixing resource 6e977c5e-85a0-4398-b359-5ba638de167e (type: routers) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:00:16.035476 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, resource={'id': '6e977c5e-85a0-4398-b359-5ba638de167e', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'project_id': '7e48d42664ae4580840a2aef59d52e53', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'external_fixed_ips': [{'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984', 'ip_address': '172.24.5.89'}, {'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c', 'ip_address': '2001:db8::d'}], 'enable_snat': True}, 'gw_port_id': '7f6e42e8-6279-4fd6-9649-d7b189f6dba8', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-a48jf', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'external_fixed_ips': [{'ip_address': '172.24.5.89', 'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984'}, {'ip_address': '2001:db8::d', 'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-07T19:41:06Z', 'updated_at': '2026-04-07T19:41:09Z', 'revision_number': 3, 'tenant_id': '7e48d42664ae4580840a2aef59d52e53'}, resource_type=routers, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:16.035795 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:16.035954 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "7f6e42e8-6279-4fd6-9649-d7b189f6dba8"')], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:16.036129 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "7f6e42e8-6279-4fd6-9649-d7b189f6dba8"')], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:16.036255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.036971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:00:16.036971 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:16.036971 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:16.036971 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:16.036971 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:16.036971 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:16.036971 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.036971 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:16.037561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Unable to update router 6e977c5e-85a0-4398-b359-5ba638de167e. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.038496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Maintenance task: Failed to fix resource 6e977c5e-85a0-4398-b359-5ba638de167e (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.038496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:00:16.038496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:00:16.038496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:00:16.038496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:00:16.038496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:00:16.038496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 07 20:00:16.038496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 07 20:00:16.038496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 07 20:00:16.038496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 07 20:00:16.038496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 07 20:00:16.039295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 07 20:00:16.039295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 07 20:00:16.039295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:16.039295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.039295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:00:16.039295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:16.039295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:16.039295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.039295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:00:16.039295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:16.039295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:00:16.039295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:16.039295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:00:16.039295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:00:16.039932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:16.039932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:00:16.039932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:16.039932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:00:16.039932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:00:16.039932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:16.039932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:00:16.039932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.039932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:00:16.039932 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Maintenance task: Fixing resource 7f6e42e8-6279-4fd6-9649-d7b189f6dba8 (type: router_ports) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:00:16.068709 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:16.072172 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:16.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:16.158644 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:16.159072 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:16.159239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.160218 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:16.160634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.161338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Traceback (most recent call last):
Apr 07 20:00:16.161338 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:16.161338 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:16.161338 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:16.161338 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:16.161338 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:16.161338 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.161338 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:16.163322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.163322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:16.163322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:16.163322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:16.163322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:16.163322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:16.163322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:16.163322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:16.163322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:16.163322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:16.163322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:16.163322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:16.163322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:16.163322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:00:16.163322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:16.163322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.163322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.163890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:16.164534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 20:00:16.164534 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:16.164534 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:16.164534 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:16.164534 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:16.164534 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:16.164534 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.164534 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:16.166924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.166924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:16.166924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:16.166924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:16.166924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:16.166924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:16.166924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:16.166924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:16.166924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:16.166924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:16.166924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:16.166924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:16.166924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:16.166924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:00:16.166924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:16.166924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.167425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:16.210334 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, resource={'id': '7f6e42e8-6279-4fd6-9649-d7b189f6dba8', 'name': '', 'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'project_id': '', 'mac_address': 'fa:16:3e:18:2e:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e977c5e-85a0-4398-b359-5ba638de167e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984', 'ip_address': '172.24.5.89'}, {'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c', 'ip_address': '2001:db8::d'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000164077', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-07T19:41:06Z', 'updated_at': '2026-04-07T19:41:09Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:16.210760 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '6de186a3-9e7c-4950-a1c6-817a37a68984 158905cc-b5be-42da-8777-3d7ded042b7c', 'neutron:network_name': 'neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-6e977c5e-85a0-4398-b359-5ba638de167e'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::d/64', '172.24.5.89/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:16.211573 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=7f6e42e8-6279-4fd6-9649-d7b189f6dba8, lrouter_port=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:16.211946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.212827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:00:16.212827 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:16.212827 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:16.212827 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:16.212827 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:16.212827 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:16.212827 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.212827 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:16.213963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Maintenance task: Failed to fix resource 7f6e42e8-6279-4fd6-9649-d7b189f6dba8 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.213963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:00:16.213963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:00:16.213963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:00:16.213963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:00:16.213963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:00:16.213963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 07 20:00:16.213963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:16.213963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.213963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:00:16.213963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:16.215772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:16.215772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.215772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:00:16.215772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:16.215772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:00:16.215772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:16.215772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:00:16.215772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:00:16.215772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:16.215772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:00:16.215772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:16.215772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:00:16.215772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:00:16.215772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:16.216423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:00:16.216423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.216423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:00:16.216423 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Maintenance task: Synchronization completed (took 0.41 seconds)
Apr 07 20:00:16.238861 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:16.239649 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:00:16.240309 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:16.240582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.241439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 20:00:16.241439 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:16.241439 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:16.241439 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:16.241439 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:16.241439 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:16.241439 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.241439 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:16.243134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.243134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:16.243134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:16.243134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:16.243134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.243134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:16.243134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:16.243134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:16.243134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.243134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:16.243134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:16.243134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:16.243134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:16.243134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:16.243134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:16.244385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:16.244385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:16.244385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:16.244385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:16.244385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:16.244385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:16.244385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:16.244385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.244385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:16.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:16.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:16.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:16.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:16.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:16.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:16.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:16.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:16.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:16.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:16.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:16.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:16.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:00:16.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:00:16.246349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:16.247274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:16.247757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:16.247757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.247757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:16.438732 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:16.439179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:16.439885 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:16.440278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.441066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:16.441066 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:16.441066 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:16.441066 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:16.441066 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:16.441066 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:16.441066 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.441066 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:16.442166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.442166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:16.442166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:16.442166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:16.442166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.442166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:16.442166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:16.442166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:16.442166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.442166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:16.442166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:16.442166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:16.442166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:16.442166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:16.442166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:16.442166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:16.443287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:16.443287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:16.443287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:16.443287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:16.443287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:16.443287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:16.443287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.443287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:16.443441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.443441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:16.443441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:16.443441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:16.443441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:16.443441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:16.443441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:16.443441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:16.443441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:16.443441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:16.443441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:16.443441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:16.443441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:16.443441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:00:16.443441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:00:16.443441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:16.443750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:16.444101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.444101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:16.502888 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:16.503397 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:16.503934 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:16.504362 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:16.504593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.505840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:16.505840 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:16.505840 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:16.505840 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:16.505840 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:16.505840 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:16.505840 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.505840 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:16.507534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.507534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:16.507534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:16.507534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:16.507534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:16.507534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:16.507534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:16.507534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:16.507534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:16.507534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:16.507534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:16.507534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:16.507534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:16.507534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:00:16.507534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:16.507534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.507534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:16.508894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:21.069486 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:21.070548 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:21.071748 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=434 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:00:21.103561 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:21.103909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.104719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Traceback (most recent call last):
Apr 07 20:00:21.104719 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:21.104719 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:21.104719 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:21.104719 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:21.104719 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:21.104719 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.104719 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:21.105857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.105857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:21.105857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:21.105857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:21.105857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:21.105857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:21.105857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:21.105857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:21.105857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:21.105857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:21.105857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:21.105857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:21.105857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:21.105857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:00:21.105857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:21.105857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:21.105857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.106451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:21.155788 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:21.156907 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:21.157175 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:21.157326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.158151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Traceback (most recent call last):
Apr 07 20:00:21.158151 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:21.158151 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:21.158151 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:21.158151 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:21.158151 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:21.158151 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.158151 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:21.159342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.159342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:21.159342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:21.159342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:21.159342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:21.159342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:21.159342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:21.159342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:21.159342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:21.159342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:21.159342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:21.159342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:21.159342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:21.159342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:00:21.159342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:21.159342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.160498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:21.239722 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:21.240142 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:00:21.240588 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:21.240862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.241466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Traceback (most recent call last):
Apr 07 20:00:21.241466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:21.241466 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:21.241466 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:21.241466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:21.241466 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:21.241466 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.241466 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:21.242052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.242052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:21.242052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:21.242052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:21.242052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:21.242052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:21.242052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:21.242052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:21.242052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:21.242052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:21.242052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:21.242052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:21.242052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:21.242052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:21.242052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:21.242839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:21.242839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:21.242839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:21.242839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:21.242839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:21.242839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:21.242839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:21.242839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.242839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:21.243391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-f89bb4e8-c3f9-4e87-a1f2-d00b21823e4d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.243391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:21.243391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:21.243391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:21.243391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:21.243391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:21.243391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:21.243391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:21.243391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:21.243391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:21.243391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:21.243391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:21.243391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:21.243391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:00:21.243391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:00:21.243391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:21.244115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:21.245418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:21.245418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.245418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:21.439551 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:21.439810 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:21.440807 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:21.441425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.442031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:21.442031 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:21.442031 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:21.442031 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:21.442031 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:21.442031 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:21.442031 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.442031 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:21.442793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.442793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:21.442793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:21.442793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:21.442793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:21.442793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:21.442793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:21.442793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:21.442793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:21.442793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:21.442793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:21.442793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:21.442793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:21.442793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:21.442793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:21.442793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:21.443522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:21.443522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:21.443522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:21.443522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:21.443522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:21.443522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:21.443522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.443522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:21.443899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.443899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:21.443899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:21.443899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:21.443899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:21.443899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:21.443899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:21.443899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:21.443899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:21.443899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:21.443899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:21.443899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:21.443899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:21.443899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:00:21.443899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:00:21.443899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:21.444383 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:21.444864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.444864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:21.503512 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:21.504366 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:21.504366 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:21.504862 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:21.504862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.505197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:21.505197 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:21.505197 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:21.505197 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:21.505197 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:21.505197 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:21.505197 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.505197 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:21.506101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.506101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:21.506101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:21.506101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:21.506101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:21.506101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:21.506101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:21.506101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:21.506101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:21.506101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:21.506101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:21.506101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:21.506101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:21.506101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:00:21.506101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:21.506101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:21.506101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:21.506677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:26.070414 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:26.072202 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:26.289568 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:26.289844 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:26.291265 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:00:26.293556 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:26.294022 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:26.294304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.296107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 20:00:26.296107 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:26.296107 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:26.296107 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:26.296107 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:26.296107 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:26.296107 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.296107 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:26.298352 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:26.300679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.300679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:26.300679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:26.300679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:26.300679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:26.300679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:26.300679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:26.300679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:26.300679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:26.300679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:26.300679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:26.300679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:26.300679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:26.300679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:00:26.300679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:26.300679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.301395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:26.304092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.305623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:26.305623 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:26.305623 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:26.305623 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:26.305623 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:26.305623 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:26.305623 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.305623 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:26.307395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.307395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:26.307395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:26.307395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:26.307395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:26.307395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:26.307395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:26.307395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:26.307395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:26.307395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:26.307395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:26.307395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:26.307395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:26.307395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:26.307395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:26.307395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:26.308241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:26.308241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:26.308241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:26.308241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:26.308241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:26.308241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:26.308241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.308241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:26.308803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.308803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:26.308803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:26.308803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:26.308803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:26.308803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:26.308803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:26.308803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:26.308803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:26.308803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:26.308803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:26.308803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:26.308803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:26.308803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:00:26.308803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:00:26.308803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:26.309468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:26.310248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:26.310248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.310248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:26.330547 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:26.330790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.331822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Traceback (most recent call last):
Apr 07 20:00:26.331822 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:26.331822 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:26.331822 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:26.331822 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:26.331822 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:26.331822 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.331822 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:26.332956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-2b05f4e0-b786-47b5-a72d-8e864beac593 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.332956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:26.332956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:26.332956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:26.332956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:26.332956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:26.332956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:26.332956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:26.332956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:26.332956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:26.332956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:26.332956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:26.332956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:26.332956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:00:26.332956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:26.332956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:26.332956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.334108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:26.440071 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:26.440539 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:26.441142 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:26.441536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.442290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:26.442290 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:26.442290 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:26.442290 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:26.442290 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:26.442290 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:26.442290 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.442290 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:26.443081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.443081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:26.443081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:26.443081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:26.443081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:26.443081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:26.443081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:26.443081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:26.443081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:26.443081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:26.443081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:26.443081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:26.443081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:26.443081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:26.443081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:26.443081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:26.443863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:26.443863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:26.443863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:26.443863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:26.443863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:26.443863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:26.443863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.443863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:26.444224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.444224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:26.444224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:26.444224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:26.444224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:26.444224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:26.444224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:26.444224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:26.444224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:26.444224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:26.444224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:26.444224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:26.444224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:26.444224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:00:26.444224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:00:26.444224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:26.444911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:26.445789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.445789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:26.504343 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:26.505012 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:26.505642 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:26.506081 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:26.506313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.507213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:26.507213 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:26.507213 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:26.507213 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:26.507213 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:26.507213 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:26.507213 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.507213 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:26.508975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.508975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:26.508975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:26.508975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:26.508975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:26.508975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:26.508975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:26.508975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:26.508975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:26.508975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:26.508975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:26.508975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:26.508975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:26.508975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:00:26.508975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:26.508975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:26.508975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:26.510226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:31.072042 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:31.072042 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:31.106369 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:31.106640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.107346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:00:31.107346 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:31.107346 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:31.107346 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:31.107346 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:31.107346 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:31.107346 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.107346 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:31.108536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.108536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:31.108536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:31.108536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:31.108536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:31.108536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:31.108536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:31.108536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:31.108536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:31.108536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:31.108536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:31.108536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:31.108536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:31.108536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:00:31.108536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:31.108536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:31.108536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.109079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:31.290612 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:31.291640 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:31.291967 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:31.292231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.292769 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:31.293367 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:00:31.294239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:31.294239 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:31.294239 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:31.294239 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:31.294239 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:31.294239 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:31.294239 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.294239 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:31.295687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.295687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:31.295687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:31.295687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:31.295687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:31.295687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:31.295687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:31.295687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:31.295687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:31.295687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:31.295687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:31.295687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:31.295687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:31.295687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:00:31.295687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:31.295687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:31.295687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.296149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:31.296599 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:31.296599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.297325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 20:00:31.297325 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:31.297325 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:31.297325 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:31.297325 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:31.297325 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:31.297325 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.297325 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:31.298281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.298281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:31.298281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:31.298281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:31.298281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:31.298281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:31.298281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:31.298281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:31.298281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:31.298281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:31.298281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:31.298281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:31.298281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:31.298281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:31.298281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:31.298744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:31.298744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:31.298744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:31.298744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:31.298744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:31.298744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:31.298744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:31.298744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.298744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:31.299470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.299470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:31.299470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:31.299470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:31.299470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:31.299470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:31.299470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:31.299470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:31.299470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:31.299470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:31.299470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:31.299470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:31.299470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:31.299470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:00:31.299470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:00:31.299470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:31.299824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:31.300198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:31.300198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.300198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:31.440804 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:31.440977 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:31.441488 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:31.441903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.442669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:31.442669 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:31.442669 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:31.442669 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:31.442669 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:31.442669 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:31.442669 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.442669 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:31.443703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.443703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:31.443703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:31.443703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:31.443703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:31.443703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:31.443703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:31.443703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:31.443703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:31.443703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:31.443703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:31.443703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:31.443703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:31.443703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:31.443703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:31.443703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:31.444110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:31.444110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:31.444110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:31.444110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:31.444110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:31.444110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:31.444110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.444110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:31.445199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.445199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:31.445199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:31.445199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:31.445199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:31.445199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:31.445199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:31.445199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:31.445199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:31.445199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:31.445199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:31.445199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:31.445199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:31.445199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:00:31.445199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:00:31.445199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:31.445576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:31.445975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.445975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:31.504969 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:31.505645 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:31.506132 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:31.506448 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:31.506607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.507198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:31.507198 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:31.507198 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:31.507198 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:31.507198 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:31.507198 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:31.507198 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.507198 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:31.508296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.508296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:31.508296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:31.508296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:31.508296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:31.508296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:31.508296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:31.508296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:31.508296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:31.508296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:31.508296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:31.508296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:31.508296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:31.508296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:00:31.508296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:31.508296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:31.508296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:31.508631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:36.071772 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:36.072615 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:36.107661 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:36.108762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.109032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:00:36.109032 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:36.109032 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:36.109032 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:36.109032 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:36.109032 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:36.109032 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.109032 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:36.110242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.110242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:36.110242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:36.110242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:36.110242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:36.110242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:36.110242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:36.110242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:36.110242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:36.110242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:36.110242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:36.110242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:36.110242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:36.110242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:00:36.110242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:36.110242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:36.110242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.111020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:36.291439 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:36.293032 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:36.293032 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:36.293032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.293219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:36.293219 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:36.293219 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:36.293219 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:36.293219 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:36.293219 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:36.293219 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.293219 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:36.294241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.294241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:36.294241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:36.294241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:36.294241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:36.294241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:36.294241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:36.294241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:36.294241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:36.294241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:36.294241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:36.294241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:36.294241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:36.294241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:00:36.294241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:36.294241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:36.294241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.294782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:36.295650 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:36.295833 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:00:36.297014 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:36.297014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.297113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:36.297113 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:36.297113 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:36.297113 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:36.297113 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:36.297113 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:36.297113 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.297113 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:36.297675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.297675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:36.297675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:36.297675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:36.297675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:36.297675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:36.297675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:36.297675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:36.297675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:36.297675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:36.297675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:36.297675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:36.297675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:36.297675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:36.297675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:36.297675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:36.298200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:36.298200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:36.298200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:36.298200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:36.298200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:36.298200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:36.298200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.298200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:36.298803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.298803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:36.298803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:36.298803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:36.298803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:36.298803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:36.298803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:36.298803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:36.298803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:36.298803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:36.298803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:36.298803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:36.298803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:36.298803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:00:36.298803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:00:36.298803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:36.299292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:36.299845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:36.299845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.299845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:36.441500 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:36.442096 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:36.442586 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:36.443882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.444206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:36.444206 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:36.444206 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:36.444206 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:36.444206 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:36.444206 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:36.444206 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.444206 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:36.446377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.446377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:36.446377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:36.446377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:36.446377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:36.446377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:36.446377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:36.446377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:36.446377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:36.446377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:36.446377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:36.446377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:36.446377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:36.446377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:36.446377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:36.446377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:36.448287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:36.448287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:36.448287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:36.448287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:36.448287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:36.448287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:36.448287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.448287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:36.449665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.449665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:36.449665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:36.449665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:36.449665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:36.449665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:36.449665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:36.449665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:36.449665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:36.449665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:36.449665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:36.449665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:36.449665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:36.449665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:00:36.449665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:00:36.449665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:36.450045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:36.450461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.450461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:36.505814 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:36.506055 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:36.506401 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:36.507054 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:36.507755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.507851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:36.507851 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:36.507851 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:36.507851 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:36.507851 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:36.507851 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:36.507851 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.507851 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:36.508787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.508787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:36.508787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:36.508787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:36.508787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:36.508787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:36.508787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:36.508787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:36.508787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:36.508787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:36.508787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:36.508787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:36.508787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:36.508787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:00:36.508787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:36.508787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:36.508787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:36.510261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:41.072299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:41.073341 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:41.107003 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:41.107003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.107003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:00:41.107003 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:41.107003 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:41.107003 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:41.107003 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:41.107003 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:41.107003 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.107003 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:41.107563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.107563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:41.107563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:41.107563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:41.107563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:41.107563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:41.107563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:41.107563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:41.107563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:41.107563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:41.107563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:41.107563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:41.107563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:41.107563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:00:41.107563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:41.107563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:41.107563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.108395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:41.292064 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:41.293690 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:41.293690 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:41.293690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.293836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:41.293836 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:41.293836 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:41.293836 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:41.293836 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:41.293836 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:41.293836 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.293836 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:41.295126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.295126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:41.295126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:41.295126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:41.295126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:41.295126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:41.295126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:41.295126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:41.295126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:41.295126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:41.295126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:41.295126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:41.295126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:41.295126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:00:41.295126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:41.295126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:41.295126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.295629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:41.296536 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:41.296730 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:00:41.297604 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:41.297604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.297690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 20:00:41.297690 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:41.297690 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:41.297690 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:41.297690 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:41.297690 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:41.297690 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.297690 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:41.298263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.298263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:41.298263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:41.298263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:41.298263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:41.298263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:41.298263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:41.298263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:41.298263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:41.298263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:41.298263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:41.298263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:41.298263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:41.298263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:41.298263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:41.298694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:41.298694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:41.298694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:41.298694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:41.298694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:41.298694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:41.298694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:41.298694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.298694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:41.299039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.299039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:41.299039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:41.299039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:41.299039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:41.299039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:41.299039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:41.299039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:41.299039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:41.299039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:41.299039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:41.299039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:41.299039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:41.299039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:00:41.299039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:00:41.299039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:41.300057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:41.300650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:41.300650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.300650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:41.442366 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:41.442949 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:41.444611 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:41.444611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.444975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:41.444975 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:41.444975 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:41.444975 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:41.444975 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:41.444975 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:41.444975 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.444975 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:41.447233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.447233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:41.447233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:41.447233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:41.447233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:41.447233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:41.447233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:41.447233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:41.447233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:41.447233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:41.447233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:41.447233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:41.447233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:41.447233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:41.447233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:41.447233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:41.447828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:41.447828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:41.447828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:41.447828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:41.447828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:41.447828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:41.447828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.447828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:41.449447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.449447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:41.449447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:41.449447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:41.449447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:41.449447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:41.449447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:41.449447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:41.449447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:41.449447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:41.449447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:41.449447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:41.449447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:41.449447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:00:41.449447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:00:41.449447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:41.449924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:41.450509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.450509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:41.506259 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:41.506910 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:41.508369 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:41.508369 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:41.508369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.508830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:41.508830 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:41.508830 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:41.508830 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:41.508830 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:41.508830 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:41.508830 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.508830 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:41.509899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.509899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:41.509899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:41.509899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:41.509899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:41.509899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:41.509899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:41.509899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:41.509899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:41.509899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:41.509899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:41.509899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:41.509899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:41.509899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:00:41.509899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:41.509899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:41.509899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:41.510746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:46.073126 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:46.074462 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:46.113575 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:46.113575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.113575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:00:46.113575 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:46.113575 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:46.113575 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:46.113575 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:46.113575 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:46.113575 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.113575 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:46.114254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.114254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:46.114254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:46.114254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:46.114254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:46.114254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:46.114254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:46.114254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:46.114254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:46.114254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:46.114254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:46.114254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:46.114254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:46.114254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:00:46.114254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:46.114254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:46.114254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.114944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:46.292488 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:46.293618 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:46.293809 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:46.293996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.294641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:46.294641 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:46.294641 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:46.294641 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:46.294641 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:46.294641 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:46.294641 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.294641 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:46.295553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.295553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:46.295553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:46.295553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:46.295553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:46.295553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:46.295553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:46.295553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:46.295553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:46.295553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:46.295553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:46.295553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:46.295553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:46.295553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:00:46.295553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:46.295553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:46.295553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.296118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:46.297073 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:46.297648 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:00:46.298122 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:46.298430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.298886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 20:00:46.298886 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:46.298886 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:46.298886 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:46.298886 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:46.298886 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:46.298886 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.298886 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:46.300209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.300209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:46.300209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:46.300209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:46.300209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:46.300209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:46.300209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:46.300209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:46.300209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:46.300209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:46.300209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:46.300209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:46.300209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:46.300209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:46.300209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:46.300905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:46.300905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:46.300905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:46.300905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:46.300905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:46.300905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:46.300905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:46.300905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.300905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:46.301780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.301780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:46.301780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:46.301780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:46.301780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:46.301780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:46.301780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:46.301780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:46.301780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:46.301780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:46.301780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:46.301780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:46.301780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:46.301780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:00:46.301780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:00:46.301780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:46.302251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:46.302605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:46.302605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.302605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:46.443513 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:46.444255 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:46.444766 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:46.445017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.445551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:46.445551 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:46.445551 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:46.445551 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:46.445551 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:46.445551 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:46.445551 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.445551 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:46.446290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.446290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:46.446290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:46.446290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:46.446290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:46.446290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:46.446290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:46.446290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:46.446290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:46.446290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:46.446290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:46.446290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:46.446290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:46.446290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:46.446290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:46.446290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:46.447451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:46.447451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:46.447451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:46.447451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:46.447451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:46.447451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:46.447451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.447451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:46.447451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.447451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:46.447451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:46.447451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:46.447451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:46.447451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:46.447451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:46.447451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:46.448209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:46.448828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:46.448828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:46.448828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:46.448828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:46.448828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:46.448828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:46.448828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:46.448828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.448828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:46.507119 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:46.507675 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:46.508388 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:46.508701 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:46.508865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.509494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:46.509494 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:46.509494 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:46.509494 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:46.509494 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:46.509494 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:46.509494 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.509494 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:46.511142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.511142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:46.511142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:46.511142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:46.511142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:46.511142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:46.511142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:46.511142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:46.511142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:46.511142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:46.511142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:46.511142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:46.511142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:46.511142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:00:46.511142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:46.511142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:46.511142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:46.511882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:51.073770 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:51.075439 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:51.115727 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:51.115955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.116653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:00:51.116653 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:51.116653 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:51.116653 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:51.116653 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:51.116653 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:51.116653 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.116653 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:51.117778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.117778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:51.117778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:51.117778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:51.117778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:51.117778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:51.117778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:51.117778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:51.117778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:51.117778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:51.117778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:51.117778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:51.117778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:51.117778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:00:51.117778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:51.117778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:51.117778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.118570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:51.293089 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:51.294167 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:51.294564 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:51.294732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.295517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 20:00:51.295517 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:51.295517 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:51.295517 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:51.295517 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:51.295517 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:51.295517 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.295517 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:51.297680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.297680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:51.297680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:51.297680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:51.297680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:51.297680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:51.297680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:51.297680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:51.297680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:51.297680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:51.297680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:51.297680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:51.297680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:51.297680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:00:51.297680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:51.297680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:51.299683 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:51.300366 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:00:51.300611 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:51.300799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:51.304143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:51.304774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:51.304774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:51.304774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:51.304774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:51.304774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:51.304774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:51.304774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:51.304774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:51.304774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:51.304774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:51.304774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:51.304774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.304774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:51.306150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.306150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:51.306150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:51.306150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:51.306150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:51.306150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:51.306150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:51.306150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:51.306150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:51.306150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:51.306150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:51.306150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:51.306150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:51.306150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:00:51.306150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:00:51.306150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:51.306688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:51.307549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:51.307549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.307549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:51.444187 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:51.444863 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:51.445236 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:51.445509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.446375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:51.446375 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:51.446375 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:51.446375 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:51.446375 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:51.446375 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:51.446375 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.446375 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:51.447329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.447329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:51.447329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:51.447329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:51.447329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:51.447329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:51.447329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:51.447329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:51.447329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:51.447329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:51.447329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:51.447329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:51.447329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:51.447329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:51.447329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:51.447329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:51.447818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:51.447818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:51.447818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:51.447818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:51.447818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:51.447818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:51.447818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.447818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:51.448475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.448475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:51.448475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:51.448475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:51.448475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:51.448475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:51.448475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:51.448475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:51.448475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:51.448475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:51.448475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:51.448475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:51.448475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:51.448475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:00:51.448475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:00:51.448475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:51.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:51.450003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.450003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:51.507711 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:51.508313 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:51.509136 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:51.509321 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:51.509496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.510108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:51.510108 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:51.510108 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:51.510108 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:51.510108 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:51.510108 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:51.510108 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.510108 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:51.511132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.511132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:51.511132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:51.511132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:51.511132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:51.511132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:51.511132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:51.511132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:51.511132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:51.511132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:51.511132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:51.511132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:51.511132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:51.511132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:00:51.511132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:51.511132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:51.511132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:51.511666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:56.074528 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:56.075942 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:56.111509 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:56.111978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.113012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:00:56.113012 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:56.113012 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:56.113012 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:56.113012 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:56.113012 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:56.113012 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.113012 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:56.114617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.114617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:56.114617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:56.114617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:56.114617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:56.114617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:56.114617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:56.114617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:56.114617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:56.114617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:56.114617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:56.114617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:56.114617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:56.114617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:00:56.114617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:56.114617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:56.114617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.115474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:56.293677 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:56.295159 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:56.295603 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:56.296001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.297235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 20:00:56.297235 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:56.297235 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:56.297235 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:56.297235 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:56.297235 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:56.297235 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.297235 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:56.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:56.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:56.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:56.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:56.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:56.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:56.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:56.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:56.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:56.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:56.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:56.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:56.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:00:56.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:56.298203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.298761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:56.300238 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:56.300688 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:00:56.301331 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:56.301693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.302472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 20:00:56.302472 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:56.302472 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:56.302472 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:56.302472 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:56.302472 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:56.302472 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.302472 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:56.304189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.304189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:56.304189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:56.304189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:56.304189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:56.304189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:56.304189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:56.304189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:56.304189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:56.304189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:56.304189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:56.304189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:56.304189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:56.304189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:56.304189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:56.304751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:56.304751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:56.304751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:56.304751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:56.304751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:56.304751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:56.304751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:56.304751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.304751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:56.306326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.306326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:56.306326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:56.306326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:56.306326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:56.306326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:56.306326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:56.306326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:56.306326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:56.306326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:56.306326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:56.306326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:56.306326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:56.306326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:00:56.306326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:00:56.306326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:56.307057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:56.307625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:56.307625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.307625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:56.444938 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:56.445300 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:56.446056 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:56.446291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.446927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:56.446927 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:56.446927 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:56.446927 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:56.446927 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:56.446927 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:56.446927 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.446927 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:56.448474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.448474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:00:56.448474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:56.448474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:56.448474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:56.448474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:56.448474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:56.448474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:56.448474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:56.448474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:00:56.448474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:56.448474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:00:56.448474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:56.448474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:00:56.448474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:00:56.448474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:56.449068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:00:56.449068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:56.449068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:00:56.449068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:00:56.449068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:56.449068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:00:56.449068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.449068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:00:56.450159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.450159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:56.450159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:56.450159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:56.450159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:56.450159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:56.450159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:56.450159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:56.450159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:56.450159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:56.450159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:56.450159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:56.450159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:56.450159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:00:56.450159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:00:56.450159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:56.450515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:56.450873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.450873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:00:56.508378 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:00:56.509075 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:00:56.510120 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:56.510559 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:00:56.510810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.511876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:00:56.511876 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:56.511876 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:00:56.511876 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:00:56.511876 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:56.511876 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:00:56.511876 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.511876 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:00:56.514400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.514400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:00:56.514400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:00:56.514400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:00:56.514400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:00:56.514400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:00:56.514400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:56.514400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:00:56.514400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:00:56.514400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:00:56.514400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:00:56.514400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:00:56.514400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:00:56.514400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:00:56.514400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:00:56.514400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:56.514400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:00:56.514747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:01.075313 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:01.114730 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:01.148695 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:01.148695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.149797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:01:01.149797 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:01.149797 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:01.149797 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:01.149797 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:01.149797 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:01.149797 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.149797 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:01.151240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.151240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:01.151240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:01.151240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:01.151240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:01.151240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:01.151240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:01.151240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:01.151240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:01.151240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:01.151240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:01.151240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:01.151240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:01.151240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:01:01.151240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:01.151240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:01.151240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.151835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:01.294282 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:01.295789 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:01.296195 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:01.296655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.298639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 20:01:01.298639 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:01.298639 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:01.298639 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:01.298639 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:01.298639 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:01.298639 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.298639 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:01.300674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.300674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:01.300674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:01.300674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:01.300674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:01.300674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:01.300674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:01.300674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:01.300674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:01.300674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:01.300674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:01.300674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:01.300674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:01.300674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:01:01.300674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:01.300674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.301434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:01.302177 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:01.302177 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:01:01.302738 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:01.303012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.303624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 20:01:01.303624 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:01.303624 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:01.303624 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:01.303624 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:01.303624 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:01.303624 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.303624 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:01.305301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.305301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:01.305301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:01.305301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:01.305301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:01.305301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:01.305301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:01.305301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:01.305301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:01.305301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:01.305301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:01.305301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:01.305301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:01.305301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:01.305301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:01.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:01.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:01.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:01.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:01.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:01.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:01.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:01.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.305913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:01.307306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.307306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:01.307306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:01.307306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:01.307306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:01.307306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:01.307306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:01.307306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:01.307306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:01.307306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:01.307306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:01.307306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:01.307306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:01.307306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:01:01.307306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:01:01.307306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:01.307874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:01.308474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:01.308474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.308474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:01.445597 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:01.446010 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:01.446573 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:01.446877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.447466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:01.447466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:01.447466 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:01.447466 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:01.447466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:01.447466 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:01.447466 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.447466 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:01.448583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.448583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:01.448583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:01.448583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:01.448583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:01.448583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:01.448583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:01.448583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:01.448583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:01.448583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:01.448583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:01.448583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:01.448583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:01.448583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:01.448583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:01.448583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:01.449376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:01.449376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:01.449376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:01.449376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:01.449376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:01.449376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:01.449376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.449376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:01.450002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.450002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:01.450002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:01.450002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:01.450002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:01.450002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:01.450002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:01.450002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:01.450002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:01.450002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:01.450002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:01.450002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:01.450002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:01.450002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:01:01.450002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:01:01.450002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:01.450686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:01.451183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.451183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:01.508919 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:01.509566 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:01.510199 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:01.510479 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:01.510636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.511533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:01.511533 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:01.511533 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:01.511533 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:01.511533 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:01.511533 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:01.511533 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.511533 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:01.512709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.512709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:01.512709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:01.512709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:01.512709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:01.512709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:01.512709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:01.512709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:01.512709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:01.512709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:01.512709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:01.512709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:01.512709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:01.512709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:01:01.512709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:01.512709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:01.512709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:01.513298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:06.114286 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:06.116045 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:06.148543 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:06.148815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.149598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:01:06.149598 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:06.149598 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:06.149598 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:06.149598 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:06.149598 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:06.149598 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.149598 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:06.150657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.150657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:06.150657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:06.150657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:06.150657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:06.150657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:06.150657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:06.150657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:06.150657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:06.150657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:06.150657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:06.150657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:06.150657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:06.150657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:01:06.150657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:06.150657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:06.150657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.151945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:06.295477 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:06.297249 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:06.297475 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:06.297630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.298721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 20:01:06.298721 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:06.298721 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:06.298721 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:06.298721 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:06.298721 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:06.298721 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.298721 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:06.301210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.301210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:06.301210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:06.301210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:06.301210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:06.301210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:06.301210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:06.301210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:06.301210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:06.301210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:06.301210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:06.301210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:06.301210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:06.301210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:01:06.301210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:06.301210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.302075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:06.303186 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:06.303186 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:01:06.303186 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:06.303186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.303186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 20:01:06.303186 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:06.303186 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:06.303186 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:06.303186 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:06.303186 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:06.303186 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.303186 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:06.304108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.304108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:06.304108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:06.304108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:06.304108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:06.304108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:06.304108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:06.304108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:06.304108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:06.304108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:06.304108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:06.304108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:06.304108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:06.304108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:06.304108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:06.305104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:06.305104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:06.305104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:06.305104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:06.305104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:06.305104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:06.305104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:06.305104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.305104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:06.305104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.305104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:06.305104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:06.305104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:06.305104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:06.305104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:06.305859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:06.306812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:06.306812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:06.306812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:06.306812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:06.306812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:06.306812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:06.306812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:06.306812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:06.306812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:06.306812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:06.306812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:06.306812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.306812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:06.446083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:06.446483 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:06.447086 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:06.447564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.448372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:06.448372 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:06.448372 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:06.448372 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:06.448372 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:06.448372 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:06.448372 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.448372 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:06.449549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.449549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:06.449549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:06.449549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:06.449549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:06.449549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:06.449549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:06.449549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:06.449549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:06.449549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:06.449549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:06.449549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:06.449549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:06.449549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:06.449549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:06.449549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:06.450305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:06.450305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:06.450305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:06.450305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:06.450305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:06.450305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:06.450305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.450305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:06.451182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.451182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:06.451182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:06.451182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:06.451182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:06.451182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:06.451182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:06.451182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:06.451182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:06.451182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:06.451182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:06.451182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:06.451182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:06.451182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:01:06.451182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:01:06.451182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:06.454638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:06.455798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.455798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:06.509599 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:06.510164 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:06.510710 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:06.511126 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:06.511361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.512151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:06.512151 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:06.512151 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:06.512151 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:06.512151 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:06.512151 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:06.512151 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.512151 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:06.513794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.513794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:06.513794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:06.513794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:06.513794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:06.513794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:06.513794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:06.513794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:06.513794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:06.513794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:06.513794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:06.513794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:06.513794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:06.513794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:01:06.513794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:06.513794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:06.513794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:06.514624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:11.115076 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:11.116928 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:11.207763 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:11.207972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.208640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:01:11.208640 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:11.208640 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:11.208640 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:11.208640 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:11.208640 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:11.208640 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.208640 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:11.209581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.209581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:11.209581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:11.209581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:11.209581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:11.209581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:11.209581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:11.209581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:11.209581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:11.209581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:11.209581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:11.209581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:11.209581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:11.209581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:01:11.209581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:11.209581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:11.209581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.210202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:11.297513 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:11.299385 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:11.299792 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:11.300324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.301414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 20:01:11.301414 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:11.301414 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:11.301414 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:11.301414 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:11.301414 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:11.301414 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.301414 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:11.303671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.303671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:11.303671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:11.303671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:11.303671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:11.303671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:11.303671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:11.303671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:11.303671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:11.303671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:11.303671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:11.303671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:11.303671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:11.303671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:01:11.303671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:11.303671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.304405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:11.305241 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:11.305241 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:01:11.305241 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:11.305241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.306201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 20:01:11.306201 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:11.306201 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:11.306201 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:11.306201 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:11.306201 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:11.306201 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.306201 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:11.307409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.307409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:11.307409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:11.307409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:11.307409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:11.307409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:11.307409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:11.307409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:11.307409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:11.307409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:11.307409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:11.307409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:11.307409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:11.307409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:11.307409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:11.308054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:11.308054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:11.308054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:11.308054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:11.308054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:11.308054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:11.308054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:11.308054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.308054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:11.308537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.308537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:11.308537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:11.308537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:11.308537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:11.308537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:11.308537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:11.308537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:11.308537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:11.308537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:11.308537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:11.308537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:11.308537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:11.308537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:01:11.308537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:01:11.308537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:11.309131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:11.309689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:11.309689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.309689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:11.446863 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:11.447238 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:11.447866 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:11.448172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.448824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:11.448824 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:11.448824 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:11.448824 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:11.448824 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:11.448824 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:11.448824 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.448824 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:11.449779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.449779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:11.449779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:11.449779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:11.449779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:11.449779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:11.449779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:11.449779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:11.449779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:11.449779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:11.449779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:11.449779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:11.449779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:11.449779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:11.449779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:11.449779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:11.450704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:11.450704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:11.450704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:11.450704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:11.450704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:11.450704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:11.450704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.450704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:11.451112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.451112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:11.451112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:11.451112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:11.451112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:11.451112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:11.451112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:11.451112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:11.451112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:11.451112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:11.451112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:11.451112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:11.451112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:11.451112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:01:11.451112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:01:11.451112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:11.451937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:11.452902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.452902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:11.510249 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:11.511087 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:11.511860 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:11.512623 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:11.512888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.513711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:11.513711 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:11.513711 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:11.513711 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:11.513711 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:11.513711 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:11.513711 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.513711 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:11.514924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.514924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:11.514924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:11.514924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:11.514924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:11.514924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:11.514924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:11.514924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:11.514924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:11.514924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:11.514924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:11.514924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:11.514924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:11.514924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:01:11.514924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:11.514924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:11.514924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:11.515629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:16.115787 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:16.117401 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:16.156734 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:16.157107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.157930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:01:16.157930 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:16.157930 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:16.157930 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:16.157930 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:16.157930 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:16.157930 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.157930 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:16.159185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.159185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:16.159185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:16.159185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:16.159185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:16.159185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:16.159185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:16.159185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:16.159185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:16.159185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:16.159185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:16.159185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:16.159185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:16.159185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:01:16.159185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:16.159185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:16.159185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.159752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:16.298216 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:16.299655 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:16.300033 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:16.300269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.301231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 20:01:16.301231 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:16.301231 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:16.301231 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:16.301231 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:16.301231 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:16.301231 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.301231 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:16.303048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.303048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:16.303048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:16.303048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:16.303048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:16.303048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:16.303048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:16.303048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:16.303048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:16.303048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:16.303048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:16.303048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:16.303048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:16.303048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:01:16.303048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:16.303048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.303782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:16.305266 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:16.305266 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:01:16.305266 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:16.305549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.306267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 20:01:16.306267 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:16.306267 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:16.306267 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:16.306267 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:16.306267 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:16.306267 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.306267 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:16.307720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.307720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:16.307720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:16.307720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:16.307720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:16.307720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:16.307720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:16.307720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:16.307720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:16.307720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:16.307720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:16.307720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:16.307720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:16.307720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:16.307720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:16.308590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:16.308590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:16.308590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:16.308590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:16.308590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:16.308590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:16.308590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:16.308590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.308590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:16.309648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.309648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:16.309648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:16.309648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:16.309648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:16.309648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:16.309648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:16.309648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:16.309648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:16.309648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:16.309648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:16.309648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:16.309648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:16.309648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:01:16.309648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:01:16.309648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:16.310115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:16.310818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:16.310818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.310818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:16.447581 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:16.447883 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:16.448501 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:16.448772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.449378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:16.449378 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:16.449378 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:16.449378 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:16.449378 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:16.449378 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:16.449378 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.449378 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:16.450628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.450628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:16.450628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:16.450628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:16.450628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:16.450628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:16.450628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:16.450628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:16.450628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:16.450628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:16.450628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:16.450628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:16.450628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:16.450628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:16.450628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:16.450628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:16.451159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:16.451159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:16.451159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:16.451159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:16.451159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:16.451159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:16.451159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.451159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:16.452341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.452341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:16.452341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:16.452341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:16.452341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:16.452341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:16.452341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:16.452341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:16.452341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:16.452341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:16.452341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:16.452341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:16.452341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:16.452341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:01:16.452341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:01:16.452341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:16.452803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:16.453317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.453317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:16.511148 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:16.511803 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:16.512408 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:16.512967 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:16.513320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.514235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:16.514235 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:16.514235 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:16.514235 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:16.514235 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:16.514235 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:16.514235 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.514235 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:16.516219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.516219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:16.516219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:16.516219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:16.516219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:16.516219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:16.516219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:16.516219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:16.516219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:16.516219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:16.516219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:16.516219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:16.516219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:16.516219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:01:16.516219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:16.516219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:16.516219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:16.516841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:21.116478 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:21.117967 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:21.119693 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=240 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:01:21.153820 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:21.154253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.155242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:01:21.155242 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:21.155242 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:21.155242 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:21.155242 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:21.155242 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:21.155242 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.155242 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:21.156353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.156353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:21.156353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:21.156353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:21.156353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:21.156353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:21.156353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:21.156353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:21.156353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:21.156353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:21.156353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:21.156353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:21.156353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:21.156353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:01:21.156353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:21.156353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:21.156353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.156880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:21.298929 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:21.300246 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:21.300596 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:21.301054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.301936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 20:01:21.301936 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:21.301936 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:21.301936 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:21.301936 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:21.301936 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:21.301936 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.301936 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:21.303567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.303567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:21.303567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:21.303567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:21.303567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:21.303567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:21.303567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:21.303567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:21.303567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:21.303567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:21.303567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:21.303567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:21.303567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:21.303567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:01:21.303567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:21.303567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.304117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:21.304711 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:21.305001 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:01:21.305610 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:21.306203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.306829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 20:01:21.306829 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:21.306829 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:21.306829 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:21.306829 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:21.306829 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:21.306829 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.306829 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:21.308252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.308252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:21.308252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:21.308252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:21.308252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:21.308252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:21.308252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:21.308252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:21.308252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:21.308252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:21.308252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:21.308252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:21.308252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:21.308252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:21.308252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:21.309183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:21.309183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:21.309183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:21.309183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:21.309183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:21.309183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:21.309183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:21.309183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.309183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:21.310145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.310145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:21.310145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:21.310145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:21.310145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:21.310145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:21.310145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:21.310145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:21.310145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:21.310145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:21.310145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:21.310145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:21.310145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:21.310145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:01:21.310145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:01:21.310145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:21.310782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:21.311353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:21.311353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.311353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:21.448130 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:21.448399 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:21.449169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:21.449639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.450584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:21.450584 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:21.450584 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:21.450584 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:21.450584 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:21.450584 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:21.450584 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.450584 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:21.452180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.452180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:21.452180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:21.452180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:21.452180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:21.452180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:21.452180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:21.452180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:21.452180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:21.452180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:21.452180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:21.452180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:21.452180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:21.452180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:21.452180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:21.452180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:21.452964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:21.452964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:21.452964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:21.452964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:21.452964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:21.452964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:21.452964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.452964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:21.454105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.454105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:21.454105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:21.454105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:21.454105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:21.454105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:21.454105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:21.454105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:21.454105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:21.454105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:21.454105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:21.454105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:21.454105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:21.454105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:01:21.454105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:01:21.454105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:21.455005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:21.455880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.455880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:21.511782 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:21.512336 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:21.513029 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:21.513472 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:21.513782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.514614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:21.514614 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:21.514614 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:21.514614 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:21.514614 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:21.514614 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:21.514614 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.514614 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:21.516373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.516373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:21.516373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:21.516373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:21.516373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:21.516373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:21.516373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:21.516373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:21.516373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:21.516373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:21.516373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:21.516373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:21.516373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:21.516373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:01:21.516373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:21.516373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:21.516373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:21.517177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:26.117204 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:26.118800 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:26.151666 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:26.152212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.153220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:01:26.153220 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:26.153220 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:26.153220 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:26.153220 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:26.153220 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:26.153220 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.153220 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:26.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:26.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:26.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:26.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:26.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:26.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:26.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:26.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:26.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:26.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:26.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:26.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:26.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:01:26.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:26.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:26.154480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.155386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:26.299545 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:26.300524 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:26.300762 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:26.300913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.301572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 20:01:26.301572 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:26.301572 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:26.301572 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:26.301572 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:26.301572 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:26.301572 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.301572 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:26.303044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.303044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:26.303044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:26.303044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:26.303044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:26.303044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:26.303044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:26.303044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:26.303044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:26.303044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:26.303044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:26.303044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:26.303044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:26.303044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:01:26.303044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:26.303044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.303585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:26.304976 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:26.305499 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:01:26.306029 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:26.306276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.307173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 20:01:26.307173 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:26.307173 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:26.307173 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:26.307173 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:26.307173 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:26.307173 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.307173 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:26.308059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.308059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:26.308059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:26.308059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:26.308059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:26.308059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:26.308059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:26.308059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:26.308059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:26.308059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:26.308059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:26.308059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:26.308059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:26.308059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:26.308059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:26.308792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:26.308792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:26.308792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:26.308792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:26.308792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:26.308792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:26.308792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:26.308792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.308792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:26.309280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.309280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:26.309280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:26.309280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:26.309280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:26.309280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:26.309280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:26.309280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:26.309280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:26.309280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:26.309280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:26.309280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:26.309280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:26.309280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:01:26.309280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:01:26.309280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:26.309898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:26.310635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:26.310635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.310635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:26.448697 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:26.449264 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:26.449888 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:26.452815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.453549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:26.453549 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:26.453549 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:26.453549 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:26.453549 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:26.453549 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:26.453549 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.453549 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:26.455189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.455189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:26.455189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:26.455189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:26.455189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:26.455189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:26.455189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:26.455189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:26.455189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:26.455189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:26.455189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:26.455189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:26.455189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:26.455189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:26.455189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:26.455189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:26.456027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:26.456027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:26.456027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:26.456027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:26.456027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:26.456027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:26.456027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.456027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:26.457377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.457377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:26.457377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:26.457377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:26.457377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:26.457377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:26.457377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:26.457377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:26.457377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:26.457377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:26.457377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:26.457377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:26.457377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:26.457377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:01:26.457377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:01:26.457377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:26.457944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:26.458485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.458485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:26.512555 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:26.513256 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:26.513788 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:26.514213 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:26.514466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.515297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:26.515297 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:26.515297 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:26.515297 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:26.515297 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:26.515297 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:26.515297 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.515297 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:26.517281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.517281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:26.517281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:26.517281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:26.517281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:26.517281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:26.517281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:26.517281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:26.517281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:26.517281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:26.517281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:26.517281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:26.517281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:26.517281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:01:26.517281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:26.517281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:26.517281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:26.518133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:31.117930 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:31.119571 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:31.152658 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:31.153033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.154018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:01:31.154018 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:31.154018 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:31.154018 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:31.154018 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:31.154018 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:31.154018 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.154018 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:31.155256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.155256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:31.155256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:31.155256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:31.155256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:31.155256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:31.155256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:31.155256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:31.155256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:31.155256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:31.155256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:31.155256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:31.155256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:31.155256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:01:31.155256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:31.155256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:31.155256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.156282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:31.300161 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:31.301783 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:31.302244 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:31.302511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.303898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 20:01:31.303898 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:31.303898 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:31.303898 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:31.303898 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:31.303898 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:31.303898 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.303898 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:31.305888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.305888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:31.305888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:31.305888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:31.305888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:31.305888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:31.305888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:31.305888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:31.305888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:31.305888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:31.305888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:31.305888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:31.305888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:31.305888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:01:31.305888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:31.305888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.306645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:31.307344 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:31.307344 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:01:31.307530 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:31.307838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.308700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Traceback (most recent call last):
Apr 07 20:01:31.308700 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:31.308700 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:31.308700 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:31.308700 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:31.308700 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:31.308700 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.308700 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:31.309672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.309672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:31.309672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:31.309672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:31.309672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:31.309672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:31.309672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:31.309672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:31.309672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:31.309672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:31.309672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:31.309672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:31.309672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:31.309672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:31.309672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:31.310219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:31.310219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:31.310219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:31.310219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:31.310219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:31.310219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:31.310219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:31.310219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.310219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:31.310756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-a190fcfd-4e2f-44de-b2f2-6bab8f1211f8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.310756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:31.310756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:31.310756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:31.310756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:31.310756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:31.310756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:31.310756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:31.310756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:31.310756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:31.310756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:31.310756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:31.310756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:31.310756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:01:31.310756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:01:31.310756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:31.311377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:31.311959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:31.311959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.311959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:31.449404 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:31.449966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:31.450820 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:31.451378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.452317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:31.452317 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:31.452317 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:31.452317 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:31.452317 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:31.452317 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:31.452317 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.452317 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:31.453545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.453545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:31.453545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:31.453545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:31.453545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:31.453545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:31.453545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:31.453545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:31.453545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:31.453545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:31.453545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:31.453545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:31.453545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:31.453545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:31.453545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:31.453545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:31.454389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:31.454389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:31.454389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:31.454389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:31.454389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:31.454389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:31.454389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.454389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:31.455007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.455007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:31.455007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:31.455007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:31.455007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:31.455007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:31.455007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:31.455007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:31.455007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:31.455007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:31.455007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:31.455007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:31.455007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:31.455007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:01:31.455007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:01:31.455007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:31.455829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:31.456712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.456712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:31.513357 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:31.513910 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:31.514421 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:31.514792 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:31.515114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.515915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:31.515915 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:31.515915 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:31.515915 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:31.515915 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:31.515915 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:31.515915 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.515915 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:31.517595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.517595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:31.517595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:31.517595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:31.517595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:31.517595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:31.517595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:31.517595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:31.517595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:31.517595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:31.517595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:31.517595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:31.517595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:31.517595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:01:31.517595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:31.517595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:31.517595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:31.518510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:36.118537 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:36.120015 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:36.162237 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:36.162519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.163236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:01:36.163236 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:36.163236 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:36.163236 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:36.163236 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:36.163236 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:36.163236 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.163236 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:36.164826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.164826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:36.164826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:36.164826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:36.164826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:36.164826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:36.164826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:36.164826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:36.164826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:36.164826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:36.164826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:36.164826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:36.164826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:36.164826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:01:36.164826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:36.164826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:36.164826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.165510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:36.350540 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:36.351294 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:36.351814 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:01:36.353705 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:36.354348 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:36.354348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.355350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:36.355350 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:36.355350 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:36.355350 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:36.355350 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:36.355350 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:36.355350 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.355350 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:36.356537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.356537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:36.356537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:36.356537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:36.356537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:36.356537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:36.356537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:36.356537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:36.356537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:36.356537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:36.356537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:36.356537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:36.356537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:36.356537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:01:36.356537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:36.356537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:36.356537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.357782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:36.359391 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:36.359391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.359391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:36.359391 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:36.359391 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:36.359391 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:36.359391 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:36.359391 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:36.359391 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.359391 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:36.359391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.359391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:36.359391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:36.359391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:36.359391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:36.359391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:36.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:36.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:36.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:36.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:36.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:36.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:36.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:36.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:36.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:36.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:36.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:36.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:36.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:36.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:36.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:36.360282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:36.361265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.361265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:36.361265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.361265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:36.361265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:36.361265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:36.361265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:36.361265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:36.361265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:36.361265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:36.361265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:36.361265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:36.361265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:36.361265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:36.361265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:36.361265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:36.361961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:36.362821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:36.362821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:36.362821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.362821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:36.450094 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:36.450588 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:36.451864 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:36.452072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.452840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:36.452840 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:36.452840 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:36.452840 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:36.452840 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:36.452840 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:36.452840 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.452840 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:36.454258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.454258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:36.454258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:36.454258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:36.454258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:36.454258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:36.454258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:36.454258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:36.454258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:36.454258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:36.454258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:36.454258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:36.454258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:36.454258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:36.454258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:36.454258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:36.455135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:36.455135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:36.455135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:36.455135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:36.455135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:36.455135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:36.455135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.455135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:36.455948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.455948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:36.455948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:36.455948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:36.455948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:36.455948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:36.455948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:36.455948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:36.455948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:36.455948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:36.455948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:36.455948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:36.455948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:36.455948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:01:36.455948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:01:36.455948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:36.456771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:36.457732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.457732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:36.514249 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:36.514723 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:36.515665 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:36.516277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:36.516640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.517792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:36.517792 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:36.517792 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:36.517792 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:36.517792 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:36.517792 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:36.517792 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.517792 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:36.519580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.519580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:36.519580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:36.519580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:36.519580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:36.519580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:36.519580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:36.519580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:36.519580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:36.519580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:36.519580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:36.519580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:36.519580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:36.519580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:01:36.519580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:36.519580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:36.519580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:36.520825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:41.119215 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:41.120965 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:41.153705 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:41.154040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.154913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:01:41.154913 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:41.154913 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:41.154913 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:41.154913 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:41.154913 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:41.154913 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.154913 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:41.155817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.155817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:41.155817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:41.155817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:41.155817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:41.155817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:41.155817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:41.155817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:41.155817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:41.155817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:41.155817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:41.155817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:41.155817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:41.155817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:01:41.155817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:41.155817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:41.155817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.156844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:41.609353 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:41.609927 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:41.612021 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:41.612468 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:41.612645 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:41.613793 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:01:41.613970 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:41.615528 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:41.618013 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:41.618013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.618769 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:41.618965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.619621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:41.619621 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:41.619621 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:41.619621 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:41.619621 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:41.619621 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:41.619621 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.619621 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:41.620012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:41.620012 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:41.620012 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:41.620012 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:41.620012 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:41.620012 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:41.620012 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.620012 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:41.621096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.621096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:41.621096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:41.621096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:41.621096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:41.621096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:41.621096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:41.621096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:41.621096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:41.621096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:41.621096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:41.621096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:41.621096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:41.621096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:41.621096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:41.621096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:41.621827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:41.621827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:41.621827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:41.621827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:41.621827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:41.621827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:41.621827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.621827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:41.621827 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:41.622245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.622245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:41.622245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:41.622245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:41.622245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:41.622245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:41.622245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:41.622245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:41.622245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:41.622245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:41.622245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:41.622245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:41.622245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:41.622245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:01:41.622245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:41.622245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:41.622245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.622779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:41.623292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.623292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:41.623292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:41.623292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:41.623292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:41.623292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:41.623292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:41.623292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:41.623292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:41.623292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:41.623292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:41.623292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:41.623292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:41.623292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:01:41.623292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:01:41.623292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:41.623786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:41.624393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:41.624906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:41.624906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:41.624906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:41.624906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:41.624906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:41.624906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:41.624906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:41.624906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:41.624906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:41.624906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:41.624906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:41.624906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:41.624906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:41.624906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:41.624906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:41.624906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:41.625372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.625372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:41.625372 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:41.625372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.625372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:41.625372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:41.625372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:41.625372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:41.625372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:41.625372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:41.625372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:41.625372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:41.625372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:41.625372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:41.625768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:41.626447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:41.626447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:41.626447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:41.626447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:41.626447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:41.626447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.626447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:41.626447 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:41.626447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.626447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:41.626447 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:41.626447 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:41.626447 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:41.626447 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:41.626447 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:41.626447 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.626447 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:41.627638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.627638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:41.627638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:41.627638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:41.627638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:41.627638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:41.627638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:41.627638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:41.627638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:41.627638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:41.627638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:41.627638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:41.627638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:41.627638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:01:41.627638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:41.627638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:41.627638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:41.628402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:46.119765 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:46.121798 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:46.162748 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:46.163081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.163930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:01:46.163930 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:46.163930 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:46.163930 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:46.163930 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:46.163930 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:46.163930 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.163930 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:46.165076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.165076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:46.165076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:46.165076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:46.165076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:46.165076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:46.165076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:46.165076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:46.165076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:46.165076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:46.165076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:46.165076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:46.165076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:46.165076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:01:46.165076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:46.165076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:46.165076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.165521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:46.610344 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:46.612436 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:46.612761 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:46.613017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.613794 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:46.613935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:46.614082 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:46.614559 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:01:46.614973 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:46.615458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:46.615458 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:46.615458 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:46.615458 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:46.615458 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:46.615458 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:46.615458 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.615458 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:46.617661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.617661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:46.617661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:46.617661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:46.617661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:46.617661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:46.617661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:46.617661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:46.617661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:46.617661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:46.617661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:46.617661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:46.617661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:46.617661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:01:46.617661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:46.617661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:46.617661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.618165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:46.618655 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:46.618655 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:46.619138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.620047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:46.620047 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:46.620047 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:46.620047 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:46.620047 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:46.620047 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:46.620047 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.620047 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:46.620646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:46.621906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.621906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:46.621906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:46.621906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:46.621906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:46.621906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:46.621906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:46.621906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:46.621906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:46.621906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:46.621906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:46.621906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:46.621906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:46.621906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:46.621906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:46.621906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:46.622397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:46.622397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:46.622397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:46.622397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:46.622397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:46.622397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:46.622397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.622397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:46.622397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.622638 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:46.623961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.623961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:46.623961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:46.623961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:46.623961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:46.623961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:46.623961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:46.623961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:46.623961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:46.623961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:46.623961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:46.623961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:46.623961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:46.623961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:01:46.623961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:01:46.623961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:46.624453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:46.624958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:46.624958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.624958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:46.624958 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:46.624958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.625475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:46.625475 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:46.625475 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:46.625475 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:46.625475 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:46.625475 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:46.625475 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.625475 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:46.625899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:46.625899 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:46.625899 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:46.625899 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:46.625899 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:46.625899 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:46.625899 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.625899 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:46.627948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.627948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:46.627948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:46.627948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:46.627948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:46.627948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:46.627948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:46.627948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:46.627948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:46.627948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:46.627948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:46.627948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:46.627948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:46.627948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:46.627948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:46.627948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:46.628373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:46.628373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:46.628373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:46.628373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:46.628373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:46.628373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:46.628373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.628373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:46.632376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.632376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:46.632376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:46.632376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:46.632376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:46.632376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:46.632376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:46.632376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:46.632376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:46.632376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:46.632376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:46.632376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:46.632376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:46.632376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:01:46.632376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:46.632376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:46.632376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.632747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:46.634249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.634249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:46.634249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:46.634249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:46.634249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:46.634249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:46.634249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:46.634249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:46.634249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:46.634249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:46.634249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:46.634249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:46.634249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:46.634249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:01:46.634249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:01:46.634249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:46.634539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:46.634892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:46.634892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:51.120976 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:51.122722 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:51.161056 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:51.161265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.161961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:01:51.161961 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:51.161961 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:51.161961 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:51.161961 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:51.161961 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:51.161961 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.161961 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:51.162832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.162832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:51.162832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:51.162832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:51.162832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:51.162832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:51.162832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:51.162832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:51.162832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:51.162832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:51.162832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:51.162832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:51.162832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:51.162832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:01:51.162832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:51.162832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:51.162832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.164204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:51.612540 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:51.612975 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:51.612975 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:51.613278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.614191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:51.614191 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:51.614191 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:51.614191 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:51.614191 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:51.614191 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:51.614191 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.614191 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:51.615554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.615554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:51.615554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:51.615554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:51.615554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:51.615554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:51.615554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:51.615554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:51.615554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:51.615554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:51.615554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:51.615554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:51.615554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:51.615554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:01:51.615554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:51.615554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:51.615554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.617063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:51.617809 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:51.617809 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:51.617809 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:51.617809 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:01:51.617809 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:51.617809 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:51.618646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:51.618646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.618768 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:51.619014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.619707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:51.619707 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:51.619707 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:51.619707 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:51.619707 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:51.619707 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:51.619707 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.619707 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:51.620969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.620969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:51.620969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:51.620969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:51.620969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:51.620969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:51.620969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:51.620969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:51.620969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:51.620969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:51.620969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:51.620969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:51.620969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:51.620969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:51.620969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:51.620969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:51.621786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:51.621786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:51.621786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:51.621786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:51.621786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:51.621786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:51.621786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.621786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:51.621786 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:51.621786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:51.621786 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:51.621786 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:51.621786 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:51.621786 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:51.621786 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:51.621786 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.621786 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:51.622868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.622868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:51.622868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:51.622868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:51.622868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:51.622868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:51.622868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:51.622868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:51.622868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:51.622868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:51.622868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:51.622868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:51.622868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:51.622868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:01:51.622868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:01:51.622868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:51.623629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:51.624670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:51.624670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.624670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:51.624670 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:51.624670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.624670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:51.624670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:51.624670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:51.624670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:51.624670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:51.624670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:51.624670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:51.624670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:51.624670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:51.624670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:51.625361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:51.625361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:51.625361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:51.625361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:51.625361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:51.625361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:51.625361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:51.625361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:51.625361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:51.625361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:51.625361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:51.625361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.625361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:51.625361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.626015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.626015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:51.626015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:51.626015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:51.626015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:51.626015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:51.626015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:51.626015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:51.626015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:51.626015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:51.626015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:51.626015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:51.626015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:51.626015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:01:51.626015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:01:51.626015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:51.626763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:51.627725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:51.628573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:51.629418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:51.629418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:51.629418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:51.629418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:51.629418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:51.629418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:51.629418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:56.121689 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:56.122529 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:56.161413 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:56.161549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.162191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:01:56.162191 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:56.162191 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:56.162191 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:56.162191 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:56.162191 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:56.162191 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.162191 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:56.163327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.163327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:56.163327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:56.163327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:56.163327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:56.163327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:56.163327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:56.163327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:56.163327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:56.163327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:56.163327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:56.163327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:56.163327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:56.163327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:01:56.163327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:56.163327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:56.163327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.163759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:56.612163 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:56.613139 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:56.613330 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:56.613447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.614054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:56.614054 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:56.614054 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:56.614054 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:56.614054 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:56.614054 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:56.614054 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.614054 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:56.615307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.615307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:56.615307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:56.615307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:56.615307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:56.615307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:56.615307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:56.615307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:56.615307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:56.615307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:56.615307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:56.615307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:56.615307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:56.615307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:01:56.615307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:56.615307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:56.615307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.615761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:56.616510 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:56.616909 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:01:56.617195 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:56.617612 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:56.618104 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:01:56.618256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.618915 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:56.619142 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:01:56.619399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:56.619399 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:56.619399 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:56.619399 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:56.619399 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:56.619399 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:56.619399 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.619399 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:56.619614 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:56.620589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.620589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:56.620589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:56.620589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:56.620589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:56.620589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:56.620589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:56.620589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:56.620589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:56.620589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:56.620589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:56.620589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:56.620589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:56.620589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:56.620589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:56.620589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:56.621017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:56.621017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:56.621017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:56.621017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:56.621017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:56.621017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:56.621017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.621017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:56.621017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.622143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.622143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:56.622143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:56.622143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:56.622143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:56.622143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:56.622143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:56.622143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:56.622143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:56.622143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:56.622143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:56.622143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:56.622143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:56.622143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:01:56.622143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:01:56.622143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:56.623118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:56.623939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:56.623939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.623939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:56.623939 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:56.623939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:56.623939 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:56.623939 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:56.623939 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:56.623939 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:56.623939 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:56.623939 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.623939 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:56.623939 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:01:56.623939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.623939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:01:56.624716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:56.624716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:56.624716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:56.624716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:56.624716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:56.624716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:56.624716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:56.624716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:01:56.624716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:56.624716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:01:56.624716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:56.624716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:01:56.624716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:01:56.624716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:56.624716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:01:56.624716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:56.624716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:01:56.626268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:01:56.626268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:56.626268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:01:56.626268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.626268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:01:56.626268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.626268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.626268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:56.626268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:56.626268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:56.626268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:56.626268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:56.626268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:56.626268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:56.626268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:56.626268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:56.626597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:01:56.626964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:01:56.627351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:01:56.627721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:01:56.627721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:01:56.627721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:01:56.627721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:01:56.627721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:01:56.627721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:01:56.627721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:01:56.627721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:01:56.627721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:01:56.627721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:01:56.627721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:01:56.627721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:01.122049 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:01.124325 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:01.160094 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:01.160379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.161138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:02:01.161138 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:01.161138 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:01.161138 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:01.161138 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:01.161138 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:01.161138 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.161138 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:01.162341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.162341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:01.162341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:01.162341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:01.162341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:01.162341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:01.162341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:01.162341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:01.162341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:01.162341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:01.162341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:01.162341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:01.162341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:01.162341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:02:01.162341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:01.162341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:01.162341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.163536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:01.665768 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:01.665768 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:01.665768 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:01.665768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.665768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:02:01.665768 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:01.665768 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:01.665768 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:01.665768 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:01.665768 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:01.665768 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.665768 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:01.668123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.668123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:01.668123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:01.668123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:01.668123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:01.668123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:01.668123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:01.668123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:01.668123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:01.668123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:01.668123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:01.668123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:01.668123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:01.668123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:02:01.668123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:01.668123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.670378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:01.670935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:01.670935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:01.670935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:01.670935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:02:01.670935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:01.670935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:01.671162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.671162 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:01.671162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.671162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:01.671162 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:01.671162 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:01.671162 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:01.671162 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:01.671162 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:01.671162 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.671162 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:01.671162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.671162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:01.671162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:01.671584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:01.671584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:01.671584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:01.671584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:01.671584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:01.671584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:01.671584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:01.671584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:01.671584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:01.671584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:01.671584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:01.671584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:01.671584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:01.671584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:01.671584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:01.671584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:01.671584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:01.672059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:01.672059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:01.672059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.672059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:01.672059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.672059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:01.672059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:01.672059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:01.672059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:01.672059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:01.672059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:01.672059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:01.672059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:01.672059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:01.672059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:01.672059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:01.672059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:01.672603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:01.673120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:01.673120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:01.673120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:01.673120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.673120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:01.673120 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:01.673120 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:01.673120 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:01.673120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:01.673120 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:01.673120 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:01.673120 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:01.673120 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:01.673120 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:01.673567 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.673567 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:01.673567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.673567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.673567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:01.673567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:01.673567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:01.673567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:01.673567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:01.673567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:01.673567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:01.673567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:01.673567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:01.673567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:01.673567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.673939 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:01.674436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.674436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:01.674436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:01.674436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:01.674436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:01.674436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:01.674436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:01.674436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:01.674436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:01.674436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:01.674436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:01.674436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:01.674436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:01.674436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:02:01.674436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:02:01.674436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:01.674821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:01.675458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:01.675458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.675458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:01.675458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.675458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:01.675458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:01.675458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:01.675458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:01.675458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:01.675458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:01.675458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:01.675458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:01.675458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:01.675458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:01.675458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:01.675458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:01.675458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:01.675888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:01.676384 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:01.676384 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:06.123756 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:06.124643 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:06.160507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:06.160802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.161685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:02:06.161685 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:06.161685 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:06.161685 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:06.161685 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:06.161685 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:06.161685 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.161685 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:06.162722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.162722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:06.162722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:06.162722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:06.162722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:06.162722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:06.162722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:06.162722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:06.162722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:06.162722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:06.162722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:06.162722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:06.162722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:06.162722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:02:06.162722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:06.162722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:06.162722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.163394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:06.613105 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:06.614370 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:06.614892 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:06.615173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.616233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:02:06.616233 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:06.616233 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:06.616233 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:06.616233 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:06.616233 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:06.616233 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.616233 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:06.617032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.617032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:06.617032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:06.617032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:06.617032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:06.617032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:06.617032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:06.617032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:06.617032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:06.617032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:06.617032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:06.617032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:06.617032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:06.617032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:02:06.617032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:06.617032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.617609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:06.619285 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:06.619285 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:06.619488 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:02:06.619930 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:06.620475 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:06.620775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.621671 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:06.622179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.623139 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:06.623544 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:06.625759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:06.625759 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:06.625759 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:06.625759 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:06.625759 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:06.625759 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:06.625759 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.625759 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:06.626721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.626721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:06.626721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:06.626721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:06.626721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:06.626721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:06.626721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:06.626721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:06.626721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:06.626721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:06.626721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:06.626721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:06.626721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:06.626721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:06.626721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:06.626721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:06.627142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:06.627142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:06.627142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:06.627142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:06.627142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:06.627142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:06.627142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.627142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:06.627142 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:06.627355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:06.627355 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:06.627355 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:06.627355 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:06.627355 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:06.627355 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:06.627355 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.627355 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:06.628070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.628070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:06.628070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:06.628070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:06.628070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:06.628070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:06.628070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:06.628070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:06.628070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:06.628070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:06.628070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:06.628070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:06.628070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:06.628070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:02:06.628070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:02:06.628070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:06.628426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:06.628764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.628764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:06.628764 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:06.629729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.629729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:06.629729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:06.629729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:06.629729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:06.629729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:06.629729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:06.629729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:06.629729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:06.629729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:06.629729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:06.629729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:06.629729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:06.629729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:06.629729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:06.629729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:06.630106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:06.630106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:06.630106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:06.630106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:06.630106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:06.630106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:06.630106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.630106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:06.630106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.630591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.630591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:06.630591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:06.630591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:06.630591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:06.630591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:06.630591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:06.630591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:06.630591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:06.630591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:06.630591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:06.630591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:06.630591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:06.630591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:02:06.630591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:02:06.630591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:06.630927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:06.631316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:06.631316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.631316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:06.631316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:06.631316 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:06.631316 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:06.631316 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:06.631316 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:06.631316 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:06.631316 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.631316 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:06.632300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.632300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:06.632300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:06.632300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:06.632300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:06.632300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:06.632300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:06.632300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:06.632300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:06.632300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:06.632300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:06.632300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:06.632300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:06.632300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:02:06.632300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:06.632300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:06.632300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:06.632672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:11.123205 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:11.124590 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:11.161886 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:11.162204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.163012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:02:11.163012 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:11.163012 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:11.163012 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:11.163012 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:11.163012 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:11.163012 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.163012 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:11.163830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.163830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:11.163830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:11.163830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:11.163830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:11.163830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:11.163830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:11.163830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:11.163830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:11.163830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:11.163830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:11.163830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:11.163830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:11.163830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:02:11.163830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:11.163830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:11.163830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.164433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:11.614644 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:11.615652 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:11.615844 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:11.615956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.616631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:11.616631 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:11.616631 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:11.616631 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:11.616631 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:11.616631 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:11.616631 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.616631 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:11.617960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.617960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:11.617960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:11.617960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:11.617960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:11.617960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:11.617960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:11.617960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:11.617960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:11.617960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:11.617960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:11.617960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:11.617960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:11.617960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:02:11.617960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:11.617960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:11.617960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.618365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:11.619513 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:11.619677 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:11.620044 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:02:11.620362 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:11.620623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.620866 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:11.621299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:11.621460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.621803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:11.621803 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:11.621803 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:11.621803 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:11.621803 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:11.621803 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:11.621803 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.621803 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:11.622619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.622619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:11.622619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:11.622619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:11.622619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:11.622619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:11.622619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:11.622619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:11.622619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:11.622619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:11.622619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:11.622619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:11.622619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:11.622619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:11.622619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:11.622619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:11.623561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:11.623561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:11.623561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:11.623561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:11.623561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:11.623561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:11.623561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.623561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:11.623561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.623561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:11.623561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:11.623561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:11.623561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:11.623561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:11.623561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:11.623561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:11.624136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.624778 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:11.627724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.627724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:11.627724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:11.627724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:11.627724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:11.627724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:11.627724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:11.627724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:11.627724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:11.627724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:11.627724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:11.627724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:11.627724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:11.627724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:11.627724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:11.627724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:11.628294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:11.628294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:11.628294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:11.628294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:11.628294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:11.628294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:11.628294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.628294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:11.628294 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:11.628294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.628294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:11.628294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:11.628294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:11.628294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:11.629776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:11.630813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:11.630813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:11.630813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:11.630813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:11.630813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:11.630813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:11.630813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:11.630813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:11.630813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:11.630813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:11.630813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:11.630813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.630813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:11.630813 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:11.630813 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:11.631181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:11.631622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:11.632071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:11.632071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:11.632071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:11.632071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:11.632071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:11.632071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:16.123876 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:16.125644 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:16.158967 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:16.159123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.159569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:02:16.159569 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:16.159569 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:16.159569 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:16.159569 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:16.159569 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:16.159569 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.159569 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:16.160500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.160500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:16.160500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:16.160500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:16.160500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:16.160500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:16.160500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:16.160500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:16.160500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:16.160500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:16.160500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:16.160500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:16.160500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:16.160500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:02:16.160500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:16.160500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:16.160500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.161083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:16.615253 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:16.616241 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:16.616480 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:16.616649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.617723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:16.617723 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:16.617723 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:16.617723 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:16.617723 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:16.617723 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:16.617723 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.617723 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:16.619114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.619114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:16.619114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:16.619114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:16.619114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:16.619114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:16.619114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:16.619114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:16.619114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:16.619114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:16.619114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:16.619114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:16.619114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:16.619114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:02:16.619114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:16.619114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:16.619114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.619537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:16.620189 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:16.620511 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:02:16.620900 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:16.621144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.621464 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:16.623452 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:16.623630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:16.623630 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:16.623630 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:16.623630 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:16.623630 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:16.623630 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:16.623630 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.623630 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:16.624707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.624707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:16.624707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:16.624707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:16.624707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:16.624707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:16.624707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:16.624707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:16.624707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:16.624707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:16.624707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:16.624707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:16.624707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:16.624707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:16.624707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:16.624707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:16.625788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:16.625788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:16.625788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:16.625788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:16.625788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:16.625788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:16.625788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.625788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:16.626199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.626199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:16.626199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:16.626199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:16.626199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:16.626199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:16.626199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:16.626199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:16.626199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:16.626199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:16.626199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:16.626199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:16.626199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:16.626199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:02:16.626199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:02:16.626199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:16.626524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:16.626866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:16.626866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.626866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:16.626866 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:16.626866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.627468 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:16.628123 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:16.628525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:16.628525 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:16.628525 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:16.628525 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:16.628525 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:16.628525 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:16.628525 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.628525 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:16.629505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.629505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:16.629505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:16.629505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:16.629505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:16.629505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:16.629505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:16.629505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:16.629505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:16.629505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:16.629505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:16.629505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:16.629505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:16.629505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:16.629505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:16.629505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:16.630174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:16.630174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:16.630174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:16.630174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:16.630174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:16.630174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:16.630174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.630174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:16.631150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.631150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:16.631150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:16.631150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:16.631150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:16.631150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:16.631150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:16.631150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:16.631150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:16.631150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:16.631150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:16.631150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:16.631150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:16.631150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:02:16.631150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:02:16.631150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:16.632209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:16.633073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.633073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:16.633073 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:16.633073 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:16.633073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.633073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:16.633073 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:16.633073 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:16.633073 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:16.633073 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:16.633073 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:16.633073 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.633073 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:16.633509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.633509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:16.633509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:16.633509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:16.633509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:16.633509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:16.633509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:16.633509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:16.633509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:16.633509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:16.633509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:16.633509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:16.633509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:16.633509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:02:16.633509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:16.633509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:16.633509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:16.633938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:21.124598 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:21.126203 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:21.128683 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=240 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:02:21.163033 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:21.163429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.164372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:02:21.164372 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:21.164372 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:21.164372 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:21.164372 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:21.164372 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:21.164372 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.164372 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:21.165746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.165746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:21.165746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:21.165746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:21.165746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:21.165746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:21.165746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:21.165746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:21.165746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:21.165746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:21.165746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:21.165746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:21.165746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:21.165746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:02:21.165746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:21.165746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:21.165746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.166699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:21.615923 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:21.617191 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:21.617526 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:21.617745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.618536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:21.618536 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:21.618536 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:21.618536 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:21.618536 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:21.618536 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:21.618536 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.618536 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:21.620507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.620507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:21.620507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:21.620507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:21.620507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:21.620507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:21.620507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:21.620507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:21.620507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:21.620507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:21.620507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:21.620507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:21.620507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:21.620507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:02:21.620507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:21.620507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:21.620507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.621436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:21.622091 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:21.622289 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:02:21.622747 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:21.623025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.623804 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:21.624188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:21.624188 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:21.624188 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:21.624188 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:21.624188 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:21.624188 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:21.624188 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.624188 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:21.625658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.625658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:21.625658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:21.625658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:21.625658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:21.625658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:21.625658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:21.625658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:21.625658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:21.625658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:21.625658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:21.625658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:21.625658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:21.625658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:21.625658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:21.625658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:21.626646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:21.626646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:21.626646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:21.626646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:21.626646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:21.626646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:21.626646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.626646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:21.627619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.627619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:21.627619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:21.627619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:21.627619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:21.627619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:21.627619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:21.627619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:21.627619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:21.627619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:21.627619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:21.627619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:21.627619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:21.627619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:02:21.627619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:02:21.627619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:21.628274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:21.628948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:21.628948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.628948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:21.628948 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:21.628948 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:21.628948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.629708 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:21.630238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:21.630238 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:21.630238 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:21.630238 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:21.630238 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:21.630238 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:21.630238 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.630238 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:21.630507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:21.631546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.631546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:21.631546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:21.631546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:21.631546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:21.631546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:21.631546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:21.631546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:21.631546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:21.631546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:21.631546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:21.631546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:21.631546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:21.631546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:21.631546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:21.631546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:21.632222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:21.632222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:21.632222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:21.632222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:21.632222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:21.632222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:21.632222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.632222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:21.632657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.632657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:21.632657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:21.632657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:21.632657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:21.632657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:21.632657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:21.632657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:21.632657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:21.632657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:21.632657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:21.632657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:21.632657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:21.632657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:02:21.632657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:02:21.632657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:21.633302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:21.634107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.634107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:21.634107 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:21.634107 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:21.634107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.634107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:21.634107 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:21.634107 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:21.634107 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:21.634107 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:21.634107 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:21.634107 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.634107 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:21.635569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.635569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:21.635569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:21.635569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:21.635569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:21.635569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:21.635569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:21.635569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:21.635569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:21.635569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:21.635569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:21.635569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:21.635569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:21.635569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:02:21.635569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:21.635569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:21.635569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:21.636268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:26.125417 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:26.168386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:26.616533 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:26.622470 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:26.622974 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:26.623327 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:26.623623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.624609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:26.624609 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:26.624609 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:26.624609 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:26.624609 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:26.624609 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:26.624609 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.624609 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:26.625915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.625915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:26.625915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:26.625915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:26.625915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:26.625915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:26.625915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:26.625915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:26.625915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:26.625915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:26.625915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:26.625915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:26.625915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:26.625915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:02:26.625915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:26.625915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:26.625915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.626801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:26.627531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:26.627531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:02:26.627625 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:26.628068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.629005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:26.629005 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:26.629005 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:26.629005 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:26.629005 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:26.629005 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:26.629005 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.629005 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:26.629639 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:26.631976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.631976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:26.631976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:26.631976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:26.631976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:26.631976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:26.631976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:26.631976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:26.631976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:26.631976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:26.631976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:26.631976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:26.631976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:26.631976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:26.631976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:26.631976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:26.632609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:26.632609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:26.632609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:26.632609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:26.632609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:26.632609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:26.632609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.632609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:26.632609 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:26.632609 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:26.633790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.633790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:26.633790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:26.633790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:26.633790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:26.633790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:26.633790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:26.633790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:26.633790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:26.633790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:26.633790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:26.633790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:26.633790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:26.633790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:02:26.633790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:02:26.633790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:26.634391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:26.635002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:26.635002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.635002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:26.635002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.635002 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:26.635465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:26.635465 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:26.635465 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:26.635465 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:26.635465 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:26.635465 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:26.635465 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.635465 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:26.635701 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:26.636718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.636718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:26.636718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:26.636718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:26.636718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:26.636718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:26.636718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:26.636718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:26.636718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:26.636718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:26.636718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:26.636718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:26.636718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:26.636718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:26.636718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:26.636718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:26.637268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:26.637268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:26.637268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:26.637268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:26.637268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:26.637268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:26.637268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.637268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:26.637268 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:26.638102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.638102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:26.638102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:26.638102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:26.638102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:26.638102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:26.638102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:26.638102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:26.638102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:26.638102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:26.638102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:26.638102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:26.638102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:26.638102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:02:26.638102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:02:26.638102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:26.638648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:26.639388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.639388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:26.639388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.639388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:26.639388 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:26.639388 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:26.639388 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:26.639388 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:26.639388 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:26.639388 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.639388 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:26.639750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.639750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:26.639750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:26.639750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:26.639750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:26.639750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:26.639750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:26.639750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:26.639750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:26.639750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:26.639750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:26.639750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:26.639750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:26.639750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:02:26.639750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:26.639750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:26.639750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:26.640444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:28.432614 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:28.433311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:28.433582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Traceback (most recent call last):
Apr 07 20:02:28.433582 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:28.433582 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:28.433582 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:28.433582 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:28.433582 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:28.433582 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:28.433582 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:28.434622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-aa7f02ab-0fb8-40c3-803f-baf199023d48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:28.434622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:28.434622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:28.434622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:28.434622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:28.434622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:28.434622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:28.434622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:28.434622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:28.434622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:28.434622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:28.434622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:28.434622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:28.434622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:02:28.434622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:28.434622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:28.434622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:28.434954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:31.167333 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:31.169151 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:31.202387 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:31.202819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.203749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:02:31.203749 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:31.203749 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:31.203749 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:31.203749 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:31.203749 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:31.203749 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.203749 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:31.204944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.204944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:31.204944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:31.204944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:31.204944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:31.204944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:31.204944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:31.204944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:31.204944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:31.204944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:31.204944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:31.204944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:31.204944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:31.204944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:02:31.204944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:31.204944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:31.204944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.205935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:31.621673 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:31.622721 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:31.623080 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:31.623301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.624058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:02:31.624058 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:31.624058 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:31.624058 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:31.624058 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:31.624058 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:31.624058 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.624058 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:31.625252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.625252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:31.625252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:31.625252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:31.625252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:31.625252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:31.625252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:31.625252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:31.625252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:31.625252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:31.625252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:31.625252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:31.625252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:31.625252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:02:31.625252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:31.625252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.625714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:31.627147 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:31.627680 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:02:31.628452 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:31.628700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.629353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:31.629353 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:31.629353 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:31.629353 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:31.629353 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:31.629353 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:31.629353 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.629353 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:31.630910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.630910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:31.630910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:31.630910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:31.630910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:31.630910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:31.630910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:31.630910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:31.630910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:31.630910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:31.630910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:31.630910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:31.630910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:31.630910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:31.630910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:31.630910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:31.631425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:31.631425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:31.631425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:31.631425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:31.631425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:31.631425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:31.631425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.631425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:31.631425 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:31.633455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.633455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:31.633455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:31.633455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:31.633455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:31.633455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:31.633455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:31.633455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:31.633455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:31.633455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:31.633455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:31.633455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:31.633455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:31.633455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:02:31.633455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:02:31.633455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:31.633895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:31.634452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:31.634452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.634452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:31.634452 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:31.634452 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:31.634452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.634776 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:31.635095 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:31.635509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:31.635509 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:31.635509 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:31.635509 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:31.635509 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:31.635509 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:31.635509 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.635509 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:31.636523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.636523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:31.636523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:31.636523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:31.636523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:31.636523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:31.636523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:31.636523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:31.636523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:31.636523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:31.636523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:31.636523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:31.636523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:31.636523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:31.636523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:31.636523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:31.636956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:31.636956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:31.636956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:31.636956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:31.636956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:31.636956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:31.636956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.636956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:31.636956 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:31.638036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.638036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:31.638036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:31.638036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:31.638036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:31.638036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:31.638036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:31.638036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:31.638036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:31.638036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:31.638036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:31.638036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:31.638036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:31.638036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:02:31.638036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:02:31.638036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:31.638707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:31.639332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.639332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:31.639332 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:31.639332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.639332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:31.639332 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:31.639332 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:31.639332 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:31.639332 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:31.639332 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:31.639332 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.639332 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:31.640105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.640105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:31.640105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:31.640105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:31.640105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:31.640105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:31.640105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:31.640105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:31.640105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:31.640105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:31.640105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:31.640105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:31.640105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:31.640105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:02:31.640105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:31.640105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:31.640105 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:31.640817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:36.167909 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:36.169205 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:36.205035 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:36.205308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.206053 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:02:36.206053 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:36.206053 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:36.206053 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:36.206053 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:36.206053 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:36.206053 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.206053 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:36.206944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.206944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:36.206944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:36.206944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:36.206944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:36.206944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:36.206944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:36.206944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:36.206944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:36.206944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:36.206944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:36.206944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:36.206944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:36.206944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:02:36.206944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:36.206944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:36.206944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.207677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:36.622390 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:36.623506 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:36.623677 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:36.623796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.624504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:02:36.624504 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:36.624504 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:36.624504 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:36.624504 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:36.624504 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:36.624504 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.624504 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:36.625747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.625747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:36.625747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:36.625747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:36.625747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:36.625747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:36.625747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:36.625747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:36.625747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:36.625747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:36.625747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:36.625747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:36.625747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:36.625747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:02:36.625747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:36.625747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.626672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:36.627850 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:36.628084 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:02:36.628604 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:36.628731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.629177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:36.629177 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:36.629177 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:36.629177 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:36.629177 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:36.629177 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:36.629177 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.629177 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:36.629785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.629785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:36.629785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:36.629785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:36.629785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:36.629785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:36.629785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:36.629785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:36.629785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:36.629785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:36.629785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:36.629785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:36.629785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:36.629785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:36.629785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:36.629785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:36.630263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:36.630263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:36.630263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:36.630263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:36.630263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:36.630263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:36.630263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.630263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:36.630734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.630734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:36.630734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:36.630734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:36.630734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:36.630734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:36.630734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:36.630734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:36.630734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:36.630734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:36.630734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:36.630734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:36.630734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:36.630734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:02:36.630734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:02:36.630734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:36.631217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:36.631731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:36.631731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.631731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:36.632529 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:36.633000 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:36.633368 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:36.633537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.634078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:36.634078 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:36.634078 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:36.634078 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:36.634078 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:36.634078 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:36.634078 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.634078 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:36.635777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.635777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:36.635777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:36.635777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:36.635777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:36.635777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:36.635777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:36.635777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:36.635777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:36.635777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:36.635777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:36.635777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:36.635777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:36.635777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:36.635777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:36.635777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:36.636234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:36.636234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:36.636234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:36.636234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:36.636234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:36.636234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:36.636234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.636234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:36.637790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.637790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:36.637790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:36.637790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:36.637790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:36.637790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:36.637790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:36.637790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:36.637790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:36.637790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:36.637790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:36.637790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:36.637790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:36.637790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:02:36.637790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:02:36.637790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:36.638265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:36.638727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.638727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:36.638727 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:36.639076 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:36.639807 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:36.640155 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:36.640713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.641504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:36.641504 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:36.641504 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:36.641504 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:36.641504 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:36.641504 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:36.641504 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.641504 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:36.642771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.642771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:36.642771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:36.642771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:36.642771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:36.642771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:36.642771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:36.642771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:36.642771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:36.642771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:36.642771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:36.642771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:36.642771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:36.642771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:02:36.642771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:36.642771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:36.642771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:36.643319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:41.168579 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:41.169719 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:41.202228 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:41.202863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.203837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:02:41.203837 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:41.203837 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:41.203837 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:41.203837 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:41.203837 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:41.203837 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.203837 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:41.204738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.204738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:41.204738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:41.204738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:41.204738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:41.204738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:41.204738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:41.204738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:41.204738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:41.204738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:41.204738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:41.204738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:41.204738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:41.204738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:02:41.204738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:41.204738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:41.204738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.205674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:41.623151 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:41.625208 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:41.625208 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:41.625208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.627014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:02:41.627014 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:41.627014 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:41.627014 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:41.627014 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:41.627014 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:41.627014 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.627014 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:41.628307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.628307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:41.628307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:41.628307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:41.628307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:41.628307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:41.628307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:41.628307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:41.628307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:41.628307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:41.628307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:41.628307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:41.628307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:41.628307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:02:41.628307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:41.628307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.629323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:41.630441 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:41.630441 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:02:41.630441 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:41.630441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.631209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:41.631209 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:41.631209 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:41.631209 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:41.631209 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:41.631209 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:41.631209 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.631209 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:41.632208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.632208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:41.632208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:41.632208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:41.632208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:41.632208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:41.632208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:41.632208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:41.632208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:41.632208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:41.632208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:41.632208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:41.632208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:41.632208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:41.632208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:41.632208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:41.633497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:41.633497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:41.633497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:41.633497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:41.633497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:41.633497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:41.633497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.633497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:41.633497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.633497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:41.633497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:41.633497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:41.633497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:41.633497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:41.633497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:41.633497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:41.634431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:41.635364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:41.635364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:41.635364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:41.635364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:41.635364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:41.635364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:41.635364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:41.635364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:41.635364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:41.635364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.635364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:41.635364 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:41.635364 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:41.636112 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:41.636112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.636189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:41.636189 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:41.636189 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:41.636189 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:41.636189 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:41.636189 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:41.636189 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.636189 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:41.637424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.637424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:41.637424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:41.637424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:41.637424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:41.637424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:41.637424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:41.637424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:41.637424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:41.637424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:41.637424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:41.637424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:41.637424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:41.637424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:41.637424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:41.637424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:41.637931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:41.637931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:41.637931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:41.637931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:41.637931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:41.637931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:41.637931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.637931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:41.638606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.638606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:41.638606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:41.638606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:41.638606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:41.638606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:41.638606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:41.638606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:41.638606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:41.638606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:41.638606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:41.638606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:41.638606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:41.638606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:02:41.638606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:02:41.638606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:41.639080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:41.639566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.639566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:41.639566 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:41.639860 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:41.640421 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:41.640824 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:41.640997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.641699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:41.641699 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:41.641699 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:41.641699 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:41.641699 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:41.641699 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:41.641699 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.641699 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:41.642966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.642966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:41.642966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:41.642966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:41.642966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:41.642966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:41.642966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:41.642966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:41.642966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:41.642966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:41.642966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:41.642966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:41.642966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:41.642966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:02:41.642966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:41.642966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:41.642966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:41.643625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:46.169295 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:46.170679 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:46.208847 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:46.209269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.210064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:02:46.210064 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:46.210064 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:46.210064 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:46.210064 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:46.210064 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:46.210064 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.210064 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:46.210888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.210888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:46.210888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:46.210888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:46.210888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:46.210888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:46.210888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:46.210888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:46.210888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:46.210888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:46.210888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:46.210888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:46.210888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:46.210888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:02:46.210888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:46.210888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:46.210888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.211787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:46.623885 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:46.625369 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:46.625697 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:46.625876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.627029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:02:46.627029 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:46.627029 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:46.627029 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:46.627029 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:46.627029 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:46.627029 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.627029 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:46.629056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.629056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:46.629056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:46.629056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:46.629056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:46.629056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:46.629056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:46.629056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:46.629056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:46.629056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:46.629056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:46.629056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:46.629056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:46.629056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:02:46.629056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:46.629056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.630714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:46.631316 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:46.631316 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:02:46.631316 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:46.631316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.632256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:02:46.632256 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:46.632256 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:46.632256 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:46.632256 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:46.632256 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:46.632256 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.632256 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:46.633611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.633611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:46.633611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:46.633611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:46.633611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:46.633611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:46.633611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:46.633611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:46.633611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:46.633611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:46.633611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:46.633611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:46.633611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:46.633611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:46.633611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:46.634164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:46.634164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:46.634164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:46.634164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:46.634164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:46.634164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:46.634164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:46.634164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.634164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:46.635559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.635559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:46.635559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:46.635559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:46.635559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:46.635559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:46.635559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:46.635559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:46.635559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:46.635559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:46.635559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:46.635559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:46.635559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:46.635559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:02:46.635559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:02:46.635559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:46.636081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:46.636611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:46.636611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.636611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:46.636611 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:46.636611 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:46.637621 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:46.637915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.638808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:46.638808 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:46.638808 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:46.638808 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:46.638808 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:46.638808 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:46.638808 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.638808 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:46.639846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.639846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:46.639846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:46.639846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:46.639846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:46.639846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:46.639846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:46.639846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:46.639846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:46.639846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:46.639846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:46.639846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:46.639846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:46.639846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:46.639846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:46.639846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:46.640765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:46.640765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:46.640765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:46.640765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:46.640765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:46.640765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:46.640765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.640765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:46.641412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.641412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:46.641412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:46.641412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:46.641412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:46.641412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:46.641412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:46.641412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:46.641412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:46.641412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:46.641412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:46.641412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:46.641412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:46.641412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:02:46.641412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:02:46.641412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:46.642399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:46.643432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.643432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:46.643432 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:46.643432 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:46.643432 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:46.643432 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:46.643432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.643918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:46.643918 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:46.643918 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:46.643918 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:46.643918 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:46.643918 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:46.643918 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.643918 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:46.645124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.645124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:46.645124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:46.645124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:46.645124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:46.645124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:46.645124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:46.645124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:46.645124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:46.645124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:46.645124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:46.645124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:46.645124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:46.645124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:02:46.645124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:46.645124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:46.645124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:46.646068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:51.169942 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:51.171673 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:51.206032 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:51.206342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.207167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:02:51.207167 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:51.207167 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:51.207167 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:51.207167 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:51.207167 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:51.207167 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.207167 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:51.208033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.208033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:51.208033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:51.208033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:51.208033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:51.208033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:51.208033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:51.208033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:51.208033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:51.208033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:51.208033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:51.208033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:51.208033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:51.208033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:02:51.208033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:51.208033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:51.208033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.209459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:51.624413 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:51.625846 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:51.626246 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:51.626491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.627507 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:51.627507 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:51.627507 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:51.627507 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:51.627507 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:51.627507 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:51.627507 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.627507 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:51.629504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.629504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:51.629504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:51.629504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:51.629504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:51.629504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:51.629504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:51.629504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:51.629504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:51.629504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:51.629504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:51.629504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:51.629504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:51.629504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:02:51.629504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:51.629504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:51.629504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.630130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:51.630603 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:51.630603 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:02:51.631215 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:51.631597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.632508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:02:51.632508 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:51.632508 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:51.632508 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:51.632508 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:51.632508 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:51.632508 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.632508 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:51.634184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.634184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:51.634184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:51.634184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:51.634184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:51.634184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:51.634184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:51.634184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:51.634184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:51.634184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:51.634184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:51.634184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:51.634184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:51.634184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:51.634184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:51.634803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:51.634803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:51.634803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:51.634803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:51.634803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:51.634803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:51.634803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:51.634803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.634803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:51.635748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.635748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:51.635748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:51.635748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:51.635748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:51.635748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:51.635748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:51.635748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:51.635748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:51.635748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:51.635748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:51.635748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:51.635748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:51.635748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:02:51.635748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:02:51.635748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:51.636466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:51.636962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:51.636962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.636962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:51.636962 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:51.636962 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:51.637380 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:51.637638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.638195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:51.638195 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:51.638195 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:51.638195 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:51.638195 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:51.638195 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:51.638195 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.638195 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:51.639347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.639347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:51.639347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:51.639347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:51.639347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:51.639347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:51.639347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:51.639347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:51.639347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:51.639347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:51.639347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:51.639347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:51.639347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:51.639347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:51.639347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:51.639347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:51.639944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:51.639944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:51.639944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:51.639944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:51.639944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:51.639944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:51.639944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.639944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:51.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:51.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:51.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:51.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:51.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:51.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:51.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:51.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:51.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:51.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:51.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:51.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:51.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:02:51.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:02:51.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:51.641438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:51.641901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.641901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:51.642244 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:51.642641 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:51.643065 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:51.643482 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:51.644002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.644854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:51.644854 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:51.644854 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:51.644854 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:51.644854 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:51.644854 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:51.644854 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.644854 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:51.645965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.645965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:51.645965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:51.645965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:51.645965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:51.645965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:51.645965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:51.645965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:51.645965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:51.645965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:51.645965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:51.645965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:51.645965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:51.645965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:02:51.645965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:51.645965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:51.645965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:51.646641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:56.170615 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:56.171893 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:56.206629 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:56.206828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.207443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:02:56.207443 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:56.207443 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:56.207443 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:56.207443 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:56.207443 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:56.207443 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.207443 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:56.208706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.208706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:56.208706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:56.208706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:56.208706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:56.208706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:56.208706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:56.208706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:56.208706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:56.208706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:56.208706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:56.208706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:56.208706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:56.208706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:02:56.208706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:56.208706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:56.208706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.209373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:56.625061 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:56.626256 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:56.626500 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:56.626702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.627439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:56.627439 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:56.627439 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:56.627439 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:56.627439 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:56.627439 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:56.627439 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.627439 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:56.629278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.629278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:56.629278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:56.629278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:56.629278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:56.629278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:56.629278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:56.629278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:56.629278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:56.629278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:56.629278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:56.629278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:56.629278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:56.629278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:02:56.629278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:56.629278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:56.629278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.629801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:56.630392 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:56.630833 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:02:56.631086 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:56.631273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.632088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:02:56.632088 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:56.632088 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:56.632088 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:56.632088 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:56.632088 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:56.632088 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.632088 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:56.632750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.632750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:56.632750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:56.632750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:56.632750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:56.632750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:56.632750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:56.632750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:56.632750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:56.632750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:56.632750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:56.632750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:56.632750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:56.632750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:56.632750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:56.633728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:56.633728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:56.633728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:56.633728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:56.633728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:56.633728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:56.633728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:56.633728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.633728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:56.633728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.633728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:56.633728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:56.633728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:56.633728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:56.633728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:56.634582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:56.635614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:56.635614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:56.635614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:56.635614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:56.635614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:56.635614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:56.635614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:56.635614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:56.635614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:56.635614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:56.635614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:56.635614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.635614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:56.636909 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:56.637365 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:56.637884 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:56.638390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.639256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:56.639256 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:56.639256 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:56.639256 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:56.639256 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:56.639256 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:56.639256 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.639256 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:56.640690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.640690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:02:56.640690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:56.640690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:56.640690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:56.640690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:56.640690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:56.640690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:56.640690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:56.640690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:02:56.640690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:56.640690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:02:56.640690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:56.640690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:02:56.640690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:02:56.640690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:56.641139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:02:56.641139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:56.641139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:02:56.641139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:02:56.641139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:56.641139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:02:56.641139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.641139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:02:56.642409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.642409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:56.642409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:56.642409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:56.642409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:56.642409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:56.642409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:56.642409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:56.642409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:56.642409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:56.642409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:56.642409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:56.642409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:56.642409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:02:56.642409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:02:56.642409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:56.642883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:56.643490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.643490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:02:56.643490 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:02:56.643490 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:02:56.643779 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:56.644299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:02:56.644623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.645661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:02:56.645661 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:56.645661 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:02:56.645661 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:02:56.645661 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:56.645661 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:02:56.645661 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.645661 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:02:56.647582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.647582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:02:56.647582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:02:56.647582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:02:56.647582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:02:56.647582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:02:56.647582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:56.647582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:02:56.647582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:02:56.647582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:02:56.647582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:02:56.647582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:02:56.647582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:02:56.647582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:02:56.647582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:02:56.647582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:56.647582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:02:56.648077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:01.171270 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:01.172953 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:01.208414 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:01.208651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.209236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:03:01.209236 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:01.209236 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:01.209236 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:01.209236 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:01.209236 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:01.209236 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.209236 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:01.210327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.210327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:01.210327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:01.210327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:01.210327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:01.210327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:01.210327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:01.210327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:01.210327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:01.210327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:01.210327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:01.210327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:01.210327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:01.210327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:03:01.210327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:01.210327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:01.210327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.211335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:01.625575 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:01.626595 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:01.626811 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:01.626931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.627623 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:01.627623 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:01.627623 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:01.627623 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:01.627623 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:01.627623 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:01.627623 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.627623 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:01.629183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.629183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:01.629183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:01.629183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:01.629183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:01.629183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:01.629183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:01.629183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:01.629183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:01.629183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:01.629183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:01.629183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:01.629183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:01.629183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:03:01.629183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:01.629183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:01.629183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.630136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:01.630908 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:01.631531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:03:01.632157 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:01.632565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.633458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:03:01.633458 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:01.633458 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:01.633458 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:01.633458 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:01.633458 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:01.633458 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.633458 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:01.635081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.635081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:01.635081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:01.635081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:01.635081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:01.635081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:01.635081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:01.635081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:01.635081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:01.635081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:01.635081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:01.635081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:01.635081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:01.635081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:01.635081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:01.635563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:01.635563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:01.635563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:01.635563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:01.635563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:01.635563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:01.635563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:01.635563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.635563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:01.636804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.636804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:01.636804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:01.636804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:01.636804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:01.636804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:01.636804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:01.636804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:01.636804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:01.636804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:01.636804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:01.636804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:01.636804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:01.636804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:03:01.636804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:03:01.636804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:01.637296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:01.637856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:01.637856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.637856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:01.637856 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:01.637856 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:01.638036 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:01.638326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.638798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:01.638798 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:01.638798 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:01.638798 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:01.638798 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:01.638798 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:01.638798 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.638798 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:01.640473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.640473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:01.640473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:01.640473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:01.640473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:01.640473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:01.640473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:01.640473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:01.640473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:01.640473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:01.640473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:01.640473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:01.640473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:01.640473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:01.640473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:01.640473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:01.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:01.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:01.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:01.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:01.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:01.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:01.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.641011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:01.641549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.641549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:01.641549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:01.641549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:01.641549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:01.641549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:01.641549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:01.641549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:01.641549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:01.641549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:01.641549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:01.641549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:01.641549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:01.641549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:03:01.641549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:03:01.641549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:01.642029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:01.642547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.642547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:01.643167 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:01.643826 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:01.644111 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:01.644337 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:01.644482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.645032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:01.645032 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:01.645032 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:01.645032 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:01.645032 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:01.645032 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:01.645032 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.645032 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:01.646131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.646131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:01.646131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:01.646131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:01.646131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:01.646131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:01.646131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:01.646131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:01.646131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:01.646131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:01.646131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:01.646131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:01.646131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:01.646131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:03:01.646131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:01.646131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:01.646131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:01.647070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:06.171977 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:06.173437 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:06.210157 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:06.210361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.211047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:03:06.211047 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:06.211047 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:06.211047 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:06.211047 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:06.211047 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:06.211047 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.211047 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:06.212535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.212535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:06.212535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:06.212535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:06.212535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:06.212535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:06.212535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:06.212535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:06.212535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:06.212535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:06.212535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:06.212535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:06.212535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:06.212535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:03:06.212535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:06.212535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:06.212535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.212960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:06.626186 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:06.627533 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:06.627874 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:06.628160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.629106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:06.629106 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:06.629106 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:06.629106 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:06.629106 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:06.629106 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:06.629106 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.629106 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:06.631535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.631535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:06.631535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:06.631535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:06.631535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:06.631535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:06.631535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:06.631535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:06.631535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:06.631535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:06.631535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:06.631535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:06.631535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:06.631535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:03:06.631535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:06.631535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:06.631535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.632852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:06.633858 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:06.633858 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:03:06.633858 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:06.633858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.633858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:03:06.633858 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:06.633858 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:06.633858 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:06.633858 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:06.633858 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:06.633858 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.633858 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:06.635100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.635100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:06.635100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:06.635100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:06.635100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:06.635100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:06.635100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:06.635100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:06.635100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:06.635100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:06.635100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:06.635100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:06.635100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:06.635100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:06.635100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:06.636047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:06.636047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:06.636047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:06.636047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:06.636047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:06.636047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:06.636047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:06.636047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.636047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:06.636600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.636600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:06.636600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:06.636600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:06.636600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:06.636600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:06.636600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:06.636600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:06.636600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:06.636600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:06.636600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:06.636600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:06.636600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:06.636600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:03:06.636600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:03:06.636600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:06.637402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:06.637939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:06.637939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.637939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:06.637939 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:06.638090 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:06.638407 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:06.638745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.639417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:06.639417 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:06.639417 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:06.639417 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:06.639417 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:06.639417 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:06.639417 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.639417 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:06.640545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.640545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:06.640545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:06.640545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:06.640545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:06.640545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:06.640545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:06.640545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:06.640545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:06.640545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:06.640545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:06.640545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:06.640545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:06.640545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:06.640545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:06.640545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:06.641054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:06.641054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:06.641054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:06.641054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:06.641054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:06.641054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:06.641054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.641054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:06.642222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.642222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:06.642222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:06.642222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:06.642222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:06.642222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:06.642222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:06.642222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:06.642222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:06.642222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:06.642222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:06.642222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:06.642222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:06.642222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:03:06.642222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:03:06.642222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:06.642710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:06.643235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.643235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:06.643642 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:06.644108 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:06.644493 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:06.644703 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:06.644868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.645388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:06.645388 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:06.645388 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:06.645388 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:06.645388 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:06.645388 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:06.645388 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.645388 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:06.647167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.647167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:06.647167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:06.647167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:06.647167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:06.647167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:06.647167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:06.647167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:06.647167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:06.647167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:06.647167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:06.647167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:06.647167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:06.647167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:03:06.647167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:06.647167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:06.647167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:06.647657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:11.181858 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:11.181858 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:11.220300 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:11.220892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.222235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:03:11.222235 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:11.222235 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:11.222235 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:11.222235 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:11.222235 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:11.222235 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.222235 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:11.223533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.223533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:11.223533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:11.223533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:11.223533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:11.223533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:11.223533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:11.223533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:11.223533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:11.223533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:11.223533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:11.223533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:11.223533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:11.223533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:03:11.223533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:11.223533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:11.223533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.224131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:11.626706 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:11.627784 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:11.628044 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:11.628243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.628792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:11.628792 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:11.628792 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:11.628792 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:11.628792 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:11.628792 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:11.628792 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.628792 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:11.629831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.629831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:11.629831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:11.629831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:11.629831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:11.629831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:11.629831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:11.629831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:11.629831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:11.629831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:11.629831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:11.629831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:11.629831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:11.629831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:03:11.629831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:11.629831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:11.629831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.630428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:11.632246 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:11.632529 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:03:11.632751 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:11.633023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.633492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:03:11.633492 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:11.633492 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:11.633492 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:11.633492 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:11.633492 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:11.633492 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.633492 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:11.634234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.634234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:11.634234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:11.634234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:11.634234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:11.634234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:11.634234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:11.634234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:11.634234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:11.634234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:11.634234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:11.634234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:11.634234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:11.634234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:11.634234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:11.635071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:11.635071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:11.635071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:11.635071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:11.635071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:11.635071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:11.635071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:11.635071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.635071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:11.635584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.635584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:11.635584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:11.635584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:11.635584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:11.635584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:11.635584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:11.635584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:11.635584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:11.635584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:11.635584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:11.635584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:11.635584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:11.635584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:03:11.635584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:03:11.635584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:11.636402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:11.637336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:11.637336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.637336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:11.637967 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:11.638197 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:11.638486 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:11.638805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.639137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:11.639137 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:11.639137 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:11.639137 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:11.639137 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:11.639137 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:11.639137 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.639137 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:11.639945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.639945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:11.639945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:11.639945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:11.639945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:11.639945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:11.639945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:11.639945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:11.639945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:11.639945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:11.639945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:11.639945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:11.639945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:11.639945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:11.639945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:11.639945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:11.640452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:11.640452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:11.640452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:11.640452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:11.640452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:11.640452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:11.640452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.640452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:11.640900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.640900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:11.640900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:11.640900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:11.640900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:11.640900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:11.640900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:11.640900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:11.640900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:11.640900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:11.640900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:11.640900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:11.640900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:11.640900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:03:11.640900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:03:11.640900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:11.641390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:11.641950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.641950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:11.644016 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:11.644457 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:11.644780 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:11.645279 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:11.645431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.646058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:11.646058 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:11.646058 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:11.646058 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:11.646058 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:11.646058 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:11.646058 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.646058 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:11.647184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.647184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:11.647184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:11.647184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:11.647184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:11.647184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:11.647184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:11.647184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:11.647184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:11.647184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:11.647184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:11.647184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:11.647184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:11.647184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:03:11.647184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:11.647184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:11.647184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:11.647727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:16.180800 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:16.206190 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:16.240263 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:16.240969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.241882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:03:16.241882 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:16.241882 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:16.241882 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:16.241882 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:16.241882 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:16.241882 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.241882 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:16.243144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.243144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:16.243144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:16.243144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:16.243144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:16.243144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:16.243144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:16.243144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:16.243144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:16.243144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:16.243144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:16.243144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:16.243144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:16.243144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:03:16.243144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:16.243144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:16.243144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.243577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:16.627910 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:16.628976 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:16.629203 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:16.629280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.629800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:16.629800 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:16.629800 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:16.629800 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:16.629800 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:16.629800 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:16.629800 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.629800 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:16.630847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.630847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:16.630847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:16.630847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:16.630847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:16.630847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:16.630847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:16.630847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:16.630847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:16.630847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:16.630847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:16.630847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:16.630847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:16.630847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:03:16.630847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:16.630847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:16.630847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.631528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:16.632585 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:16.632825 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:03:16.633183 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:16.633434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.633920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:03:16.633920 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:16.633920 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:16.633920 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:16.633920 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:16.633920 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:16.633920 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.633920 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:16.634763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.634763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:16.634763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:16.634763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:16.634763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:16.634763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:16.634763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:16.634763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:16.634763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:16.634763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:16.634763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:16.634763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:16.634763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:16.634763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:16.634763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:16.635253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:16.635253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:16.635253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:16.635253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:16.635253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:16.635253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:16.635253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:16.635253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.635253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:16.635808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.635808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:16.635808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:16.635808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:16.635808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:16.635808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:16.635808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:16.635808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:16.635808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:16.635808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:16.635808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:16.635808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:16.635808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:16.635808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:03:16.635808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:03:16.635808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:16.636287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:16.636805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:16.636805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.636805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:16.638287 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:16.638465 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:16.638883 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:16.638969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.639395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:16.639395 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:16.639395 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:16.639395 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:16.639395 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:16.639395 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:16.639395 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.639395 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:16.640270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.640270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:16.640270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:16.640270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:16.640270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:16.640270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:16.640270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:16.640270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:16.640270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:16.640270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:16.640270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:16.640270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:16.640270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:16.640270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:16.640270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:16.640270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:16.640728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:16.640728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:16.640728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:16.640728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:16.640728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:16.640728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:16.640728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.640728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:16.641262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.641262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:16.641262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:16.641262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:16.641262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:16.641262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:16.641262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:16.641262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:16.641262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:16.641262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:16.641262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:16.641262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:16.641262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:16.641262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:03:16.641262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:03:16.641262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:16.641732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:16.642313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.642313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:16.644398 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:16.645005 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:16.645736 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:16.646236 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:16.646487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.647386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:16.647386 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:16.647386 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:16.647386 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:16.647386 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:16.647386 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:16.647386 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.647386 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:16.648911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.648911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:16.648911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:16.648911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:16.648911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:16.648911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:16.648911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:16.648911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:16.648911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:16.648911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:16.648911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:16.648911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:16.648911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:16.648911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:03:16.648911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:16.648911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:16.648911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:16.649804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:21.181415 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:21.182833 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:21.184640 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=240 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:03:21.282540 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:21.282776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.283428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:03:21.283428 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:21.283428 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:21.283428 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:21.283428 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:21.283428 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:21.283428 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.283428 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:21.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:21.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:21.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:21.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:21.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:21.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:21.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:21.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:21.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:21.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:21.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:21.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:21.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:03:21.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:21.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:21.284535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.285049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:21.628353 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:21.629630 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:21.629918 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:21.630111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.630941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:21.630941 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:21.630941 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:21.630941 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:21.630941 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:21.630941 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:21.630941 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.630941 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:21.632594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.632594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:21.632594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:21.632594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:21.632594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:21.632594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:21.632594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:21.632594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:21.632594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:21.632594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:21.632594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:21.632594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:21.632594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:21.632594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:03:21.632594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:21.632594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:21.632594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.633295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:21.633806 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:21.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:03:21.634262 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:21.634460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.635067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:03:21.635067 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:21.635067 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:21.635067 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:21.635067 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:21.635067 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:21.635067 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.635067 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:21.635849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.635849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:21.635849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:21.635849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:21.635849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:21.635849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:21.635849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:21.635849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:21.635849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:21.635849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:21.635849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:21.635849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:21.635849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:21.635849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:21.635849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:21.636417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:21.636417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:21.636417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:21.636417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:21.636417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:21.636417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:21.636417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:21.636417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.636417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:21.636892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.636892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:21.636892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:21.636892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:21.636892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:21.636892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:21.636892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:21.636892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:21.636892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:21.636892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:21.636892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:21.636892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:21.636892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:21.636892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:03:21.636892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:03:21.636892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:21.637493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:21.638047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:21.638047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.638047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:21.638575 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:21.638827 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:21.639210 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:21.639426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.639834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:21.639834 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:21.639834 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:21.639834 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:21.639834 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:21.639834 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:21.639834 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.639834 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:21.640850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.640850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:21.640850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:21.640850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:21.640850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:21.640850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:21.640850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:21.640850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:21.640850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:21.640850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:21.640850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:21.640850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:21.640850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:21.640850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:21.640850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:21.640850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:21.641532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:21.641532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:21.641532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:21.641532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:21.641532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:21.641532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:21.641532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.641532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:21.642226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.642226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:21.642226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:21.642226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:21.642226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:21.642226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:21.642226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:21.642226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:21.642226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:21.642226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:21.642226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:21.642226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:21.642226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:21.642226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:03:21.642226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:03:21.642226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:21.642749 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:21.643330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.643330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:21.644717 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:21.645125 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:21.645456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:21.645725 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:21.645916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.646653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:21.646653 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:21.646653 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:21.646653 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:21.646653 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:21.646653 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:21.646653 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.646653 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:21.647843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.647843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:21.647843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:21.647843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:21.647843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:21.647843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:21.647843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:21.647843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:21.647843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:21.647843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:21.647843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:21.647843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:21.647843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:21.647843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:03:21.647843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:21.647843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:21.647843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:21.648676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:26.182047 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:26.183520 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:26.217576 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:26.217817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.218492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:03:26.218492 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:26.218492 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:26.218492 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:26.218492 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:26.218492 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:26.218492 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.218492 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:26.219434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.219434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:26.219434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:26.219434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:26.219434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:26.219434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:26.219434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:26.219434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:26.219434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:26.219434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:26.219434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:26.219434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:26.219434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:26.219434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:03:26.219434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:26.219434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:26.219434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.220843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:26.629137 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:26.630394 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:26.630747 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:26.631024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.632092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:26.632092 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:26.632092 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:26.632092 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:26.632092 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:26.632092 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:26.632092 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.632092 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:26.633393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.633393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:26.633393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:26.633393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:26.633393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:26.633393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:26.633393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:26.633393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:26.633393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:26.633393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:26.633393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:26.633393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:26.633393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:26.633393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:03:26.633393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:26.633393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:26.633393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.634376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:26.635195 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:26.635195 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:03:26.635195 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:26.635195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.635679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:03:26.635679 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:26.635679 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:26.635679 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:26.635679 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:26.635679 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:26.635679 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.635679 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:26.636885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.636885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:26.636885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:26.636885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:26.636885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:26.636885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:26.636885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:26.636885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:26.636885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:26.636885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:26.636885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:26.636885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:26.636885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:26.636885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:26.636885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:26.637722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:26.637722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:26.637722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:26.637722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:26.637722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:26.637722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:26.637722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:26.637722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.637722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:26.638534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.638534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:26.638534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:26.638534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:26.638534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:26.638534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:26.638534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:26.638534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:26.638534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:26.638534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:26.638534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:26.638534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:26.638534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:26.638534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:03:26.638534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:03:26.638534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:26.639365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:26.639913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:26.639913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.639913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:26.639913 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:26.639913 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:26.639913 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:26.640159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.640662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:26.640662 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:26.640662 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:26.640662 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:26.640662 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:26.640662 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:26.640662 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.640662 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:26.641521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.641521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:26.641521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:26.641521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:26.641521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:26.641521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:26.641521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:26.641521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:26.641521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:26.641521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:26.641521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:26.641521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:26.641521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:26.641521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:26.641521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:26.641521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:26.642176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:26.642176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:26.642176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:26.642176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:26.642176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:26.642176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:26.642176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.642176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:26.642626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.642626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:26.642626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:26.642626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:26.642626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:26.642626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:26.642626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:26.642626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:26.642626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:26.642626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:26.642626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:26.642626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:26.642626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:26.642626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:03:26.642626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:03:26.642626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:26.643172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:26.643774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.643774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:26.645219 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:26.645619 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:26.646272 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:26.646554 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:26.646725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.647359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:26.647359 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:26.647359 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:26.647359 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:26.647359 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:26.647359 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:26.647359 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.647359 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:26.648466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.648466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:26.648466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:26.648466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:26.648466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:26.648466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:26.648466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:26.648466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:26.648466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:26.648466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:26.648466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:26.648466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:26.648466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:26.648466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:03:26.648466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:26.648466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:26.648466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:26.648959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:31.182745 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:31.184250 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:31.216469 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:31.216830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.217721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:03:31.217721 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:31.217721 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:31.217721 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:31.217721 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:31.217721 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:31.217721 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.217721 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:31.219037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.219037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:31.219037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:31.219037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:31.219037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:31.219037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:31.219037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:31.219037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:31.219037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:31.219037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:31.219037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:31.219037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:31.219037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:31.219037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:03:31.219037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:31.219037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:31.219037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.219830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:31.629625 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:31.630632 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:31.630922 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:31.631100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.631804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:31.631804 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:31.631804 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:31.631804 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:31.631804 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:31.631804 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:31.631804 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.631804 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:31.633260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.633260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:31.633260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:31.633260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:31.633260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:31.633260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:31.633260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:31.633260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:31.633260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:31.633260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:31.633260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:31.633260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:31.633260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:31.633260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:03:31.633260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:31.633260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:31.633260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.633854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:31.634507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:31.634759 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:03:31.635167 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:31.635375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.635887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:03:31.635887 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:31.635887 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:31.635887 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:31.635887 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:31.635887 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:31.635887 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.635887 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:31.636473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.636473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:31.636473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:31.636473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:31.636473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:31.636473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:31.636473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:31.636473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:31.636473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:31.636473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:31.636473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:31.636473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:31.636473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:31.636473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:31.636473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:31.637234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:31.637234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:31.637234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:31.637234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:31.637234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:31.637234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:31.637234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:31.637234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.637234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:31.637641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.637641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:31.637641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:31.637641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:31.637641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:31.637641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:31.637641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:31.637641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:31.637641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:31.637641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:31.637641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:31.637641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:31.637641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:31.637641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:03:31.637641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:03:31.637641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:31.638309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:31.638852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:31.638852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.638852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:31.639349 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:31.639704 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:31.639966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:31.640150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.640502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:31.640502 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:31.640502 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:31.640502 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:31.640502 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:31.640502 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:31.640502 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.640502 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:31.641632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.641632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:31.641632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:31.641632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:31.641632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:31.641632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:31.641632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:31.641632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:31.641632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:31.641632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:31.641632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:31.641632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:31.641632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:31.641632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:31.641632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:31.641632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:31.642162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:31.642162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:31.642162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:31.642162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:31.642162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:31.642162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:31.642162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.642162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:31.643392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.643392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:31.643392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:31.643392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:31.643392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:31.643392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:31.643392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:31.643392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:31.643392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:31.643392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:31.643392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:31.643392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:31.643392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:31.643392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:03:31.643392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:03:31.643392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:31.643869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:31.644387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.644387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:31.645710 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:31.646260 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:31.646484 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:31.646784 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:31.646938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.647554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:31.647554 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:31.647554 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:31.647554 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:31.647554 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:31.647554 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:31.647554 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.647554 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:31.648612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.648612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:31.648612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:31.648612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:31.648612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:31.648612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:31.648612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:31.648612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:31.648612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:31.648612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:31.648612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:31.648612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:31.648612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:31.648612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:03:31.648612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:31.648612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:31.648612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:31.649563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:36.183469 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:36.184723 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:36.220454 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:36.220932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.221752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:03:36.221752 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:36.221752 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:36.221752 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:36.221752 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:36.221752 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:36.221752 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.221752 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:36.222638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.222638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:36.222638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:36.222638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:36.222638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:36.222638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:36.222638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:36.222638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:36.222638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:36.222638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:36.222638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:36.222638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:36.222638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:36.222638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:03:36.222638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:36.222638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:36.222638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.223487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:36.630338 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:36.631341 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:36.631530 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:36.631673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.632410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:36.632410 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:36.632410 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:36.632410 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:36.632410 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:36.632410 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:36.632410 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.632410 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:36.634198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.634198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:36.634198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:36.634198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:36.634198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:36.634198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:36.634198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:36.634198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:36.634198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:36.634198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:36.634198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:36.634198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:36.634198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:36.634198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:03:36.634198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:36.634198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:36.634198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.635558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:36.636829 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:36.636829 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:03:36.636829 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:36.636829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.636829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:03:36.636829 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:36.636829 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:36.636829 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:36.636829 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:36.636829 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:36.636829 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.636829 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:36.637910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.637910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:36.637910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:36.637910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:36.637910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:36.637910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:36.637910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:36.637910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:36.637910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:36.637910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:36.637910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:36.637910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:36.637910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:36.637910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:36.637910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:36.638610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:36.638610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:36.638610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:36.638610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:36.638610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:36.638610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:36.638610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:36.638610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.638610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:36.638948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.638948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:36.638948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:36.638948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:36.638948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:36.638948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:36.638948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:36.638948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:36.638948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:36.638948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:36.638948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:36.638948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:36.638948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:36.638948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:03:36.638948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:03:36.638948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:36.639673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:36.640386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:36.640386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.640386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:36.640386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:36.640386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:36.640386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:36.640731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.641560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:36.641560 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:36.641560 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:36.641560 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:36.641560 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:36.641560 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:36.641560 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.641560 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:36.642298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.642298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:36.642298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:36.642298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:36.642298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:36.642298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:36.642298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:36.642298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:36.642298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:36.642298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:36.642298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:36.642298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:36.642298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:36.642298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:36.642298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:36.642298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:36.642968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:36.642968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:36.642968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:36.642968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:36.642968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:36.642968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:36.642968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.642968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:36.643402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.643402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:36.643402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:36.643402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:36.643402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:36.643402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:36.643402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:36.643402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:36.643402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:36.643402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:36.643402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:36.643402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:36.643402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:36.643402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:03:36.643402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:03:36.643402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:36.644055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:36.644803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.644803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:36.646174 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:36.646583 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:36.647094 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:36.647499 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:36.647735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.648516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:36.648516 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:36.648516 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:36.648516 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:36.648516 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:36.648516 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:36.648516 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.648516 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:36.650597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.650597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:36.650597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:36.650597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:36.650597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:36.650597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:36.650597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:36.650597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:36.650597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:36.650597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:36.650597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:36.650597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:36.650597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:36.650597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:03:36.650597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:36.650597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:36.650597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:36.651081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:41.184082 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:41.186175 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:41.222811 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:41.223047 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.223729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:03:41.223729 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:41.223729 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:41.223729 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:41.223729 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:41.223729 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:41.223729 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.223729 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:41.225069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.225069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:41.225069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:41.225069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:41.225069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:41.225069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:41.225069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:41.225069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:41.225069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:41.225069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:41.225069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:41.225069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:41.225069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:41.225069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:03:41.225069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:41.225069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:41.225069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.225648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:41.630959 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:41.632061 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:41.632263 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:41.632391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.633034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:41.633034 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:41.633034 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:41.633034 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:41.633034 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:41.633034 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:41.633034 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.633034 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:41.634323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.634323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:41.634323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:41.634323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:41.634323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:41.634323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:41.634323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:41.634323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:41.634323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:41.634323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:41.634323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:41.634323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:41.634323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:41.634323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:03:41.634323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:41.634323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:41.634323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.634947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:41.635573 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:41.635803 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:03:41.636263 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:41.636482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.637212 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:03:41.637212 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:41.637212 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:41.637212 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:41.637212 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:41.637212 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:41.637212 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.637212 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:41.638755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.638755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:41.638755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:41.638755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:41.638755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:41.638755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:41.638755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:41.638755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:41.638755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:41.638755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:41.638755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:41.638755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:41.638755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:41.638755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:41.638755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:41.639594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:41.639594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:41.639594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:41.639594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:41.639594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:41.639594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:41.639594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:41.639594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.639594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:41.640745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.640745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:41.640745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:41.640745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:41.640745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:41.640745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:41.640745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:41.640745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:41.640745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:41.640745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:41.640745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:41.640745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:41.640745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:41.640745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:03:41.640745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:03:41.640745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:41.641352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:41.642362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:41.642362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.642362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:41.642362 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:41.642362 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:41.642362 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:41.642362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.642655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:41.642655 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:41.642655 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:41.642655 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:41.642655 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:41.642655 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:41.642655 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.642655 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:41.644190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.644190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:41.644190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:41.644190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:41.644190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:41.644190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:41.644190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:41.644190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:41.644190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:41.644190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:41.644190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:41.644190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:41.644190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:41.644190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:41.644190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:41.644190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:41.644646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:41.644646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:41.644646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:41.644646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:41.644646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:41.644646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:41.644646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.644646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:41.645964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.645964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:41.645964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:41.645964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:41.645964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:41.645964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:41.645964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:41.645964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:41.645964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:41.645964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:41.645964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:41.645964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:41.645964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:41.645964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:03:41.645964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:03:41.645964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:41.646497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:41.647197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.647197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:41.647197 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:41.647304 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:41.647735 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:41.648008 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:41.648175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.648758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:41.648758 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:41.648758 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:41.648758 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:41.648758 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:41.648758 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:41.648758 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.648758 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:41.650635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.650635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:41.650635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:41.650635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:41.650635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:41.650635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:41.650635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:41.650635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:41.650635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:41.650635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:41.650635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:41.650635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:41.650635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:41.650635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:03:41.650635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:41.650635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:41.650635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:41.651130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:46.184699 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:46.186145 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:46.223132 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:46.223660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.224869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:03:46.224869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:46.224869 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:46.224869 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:46.224869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:46.224869 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:46.224869 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.224869 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:46.226300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.226300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:46.226300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:46.226300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:46.226300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:46.226300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:46.226300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:46.226300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:46.226300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:46.226300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:46.226300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:46.226300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:46.226300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:46.226300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:03:46.226300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:46.226300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:46.226300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.227050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:46.631514 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:46.632760 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:46.633161 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:46.633399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.634364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:46.634364 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:46.634364 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:46.634364 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:46.634364 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:46.634364 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:46.634364 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.634364 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:46.636185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.636185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:46.636185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:46.636185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:46.636185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:46.636185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:46.636185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:46.636185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:46.636185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:46.636185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:46.636185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:46.636185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:46.636185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:46.636185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:03:46.636185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:46.636185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:46.636185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.637055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:46.637711 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:46.637711 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:03:46.637711 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:46.637711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.638395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:03:46.638395 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:46.638395 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:46.638395 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:46.638395 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:46.638395 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:46.638395 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.638395 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:46.639875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.639875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:46.639875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:46.639875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:46.639875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:46.639875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:46.639875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:46.639875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:46.639875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:46.639875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:46.639875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:46.639875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:46.639875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:46.639875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:46.639875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:46.640386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:46.640386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:46.640386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:46.640386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:46.640386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:46.640386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:46.640386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:46.640386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.640386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:46.642326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.642326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:46.642326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:46.642326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:46.642326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:46.642326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:46.642326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:46.642326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:46.642326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:46.642326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:46.642326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:46.642326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:46.642326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:46.642326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:03:46.642326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:03:46.642326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:46.642811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:46.643355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:46.643355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.643355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:46.643355 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:46.643355 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:46.643706 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:46.643935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.644501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:46.644501 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:46.644501 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:46.644501 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:46.644501 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:46.644501 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:46.644501 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.644501 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:46.645935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.645935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:46.645935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:46.645935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:46.645935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:46.645935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:46.645935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:46.645935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:46.645935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:46.645935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:46.645935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:46.645935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:46.645935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:46.645935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:46.645935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:46.645935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:46.646431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:46.646431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:46.646431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:46.646431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:46.646431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:46.646431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:46.646431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.646431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:46.647905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.647905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:46.647905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:46.647905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:46.647905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:46.647905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:46.647905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:46.647905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:46.647905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:46.647905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:46.647905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:46.647905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:46.647905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:46.647905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:03:46.647905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:03:46.647905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:46.648417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:46.648933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.648933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:46.648933 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:46.648933 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:46.649090 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:46.649357 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:46.649595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.650395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:46.650395 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:46.650395 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:46.650395 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:46.650395 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:46.650395 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:46.650395 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.650395 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:46.651468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.651468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:46.651468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:46.651468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:46.651468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:46.651468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:46.651468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:46.651468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:46.651468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:46.651468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:46.651468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:46.651468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:46.651468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:46.651468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:03:46.651468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:46.651468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:46.651468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:46.651945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:51.185263 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:51.186969 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:51.221552 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:51.222098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.222877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:03:51.222877 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:51.222877 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:51.222877 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:51.222877 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:51.222877 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:51.222877 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.222877 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:51.224200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.224200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:51.224200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:51.224200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:51.224200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:51.224200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:51.224200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:51.224200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:51.224200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:51.224200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:51.224200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:51.224200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:51.224200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:51.224200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:03:51.224200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:51.224200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:51.224200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.225083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:51.644908 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:51.645453 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:51.645707 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:51.646781 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:03:51.647159 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:51.647854 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:51.648092 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:51.648233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.649259 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:51.649554 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:51.649759 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:51.650101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.650270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:51.650270 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:51.650270 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:51.650270 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:51.650270 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:51.650270 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:51.650270 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.650270 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:51.650912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:51.650912 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:51.650912 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:51.650912 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:51.650912 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:51.650912 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:51.650912 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.650912 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:51.651841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.651841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:51.651841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:51.651841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:51.651841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:51.651841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:51.651841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:51.651841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:51.651841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:51.651841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:51.651841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:51.651841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:51.651841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:51.651841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:03:51.651841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:51.651841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:51.651841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.652281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:51.652636 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:51.653186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.653186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:51.653186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:51.653186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:51.653186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:51.653186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:51.653186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:51.653186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:51.653186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:51.653186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:51.653186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:51.653186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:51.653186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:51.653186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:51.653186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:51.653186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:51.653852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:51.653852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:51.653852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:51.653852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:51.653852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:51.653852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:51.653852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.653852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:51.653852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.654827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.654827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:51.654827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:51.654827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:51.654827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:51.654827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:51.654827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:51.654827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:51.654827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:51.654827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:51.654827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:51.654827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:51.654827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:51.654827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:03:51.654827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:03:51.654827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:51.655176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:51.655565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:51.655565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.655565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:51.655565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Traceback (most recent call last):
Apr 07 20:03:51.655565 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:51.655565 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:51.655565 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:51.655565 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:51.655565 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:51.655565 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.655565 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:51.656286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.656286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:51.656286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:51.656286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:51.656286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:51.656286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:51.656286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:51.656286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:51.656286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:51.656286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:51.656286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:51.656286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:51.656286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:51.656286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:51.656286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:51.656635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:51.656635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:51.656635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:51.656635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:51.656635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:51.656635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:51.656635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:51.656635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.656635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:51.658079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.658079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:51.658079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:51.658079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:51.658079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:51.658079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:51.658079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:51.658079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:51.658079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:51.658079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:51.658079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:51.658079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:51.658079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:51.658079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:03:51.658079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:03:51.658079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:51.658564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:51.659138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.659138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:51.659138 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:51.659294 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:51.659592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.660792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Traceback (most recent call last):
Apr 07 20:03:51.660792 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:51.660792 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:51.660792 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:51.660792 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:51.660792 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:51.660792 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.660792 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:51.662109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.662109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:51.662109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:51.662109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:51.662109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:51.662109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:51.662109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:51.662109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:51.662109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:51.662109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:51.662109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:51.662109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:51.662109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:51.662109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:03:51.662109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:51.662109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:51.662109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:51.662632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:56.187459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:56.189717 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:56.224229 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:56.224229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.224493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:03:56.224493 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:56.224493 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:56.224493 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:56.224493 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:56.224493 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:56.224493 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.224493 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:56.225349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.225349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:56.225349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:56.225349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:56.225349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:56.225349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:56.225349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:56.225349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:56.225349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:56.225349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:56.225349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:56.225349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:56.225349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:56.225349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:03:56.225349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:56.225349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:56.225349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.225836 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:56.646562 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:56.646922 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:56.647238 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:56.648533 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:03:56.649541 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:03:56.709852 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:56.709852 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4d2c9a67-f039-4057-a878-f3ca4d48758f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:03:56.710928 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:56.711590 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:56.711590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.712478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Traceback (most recent call last):
Apr 07 20:03:56.712478 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:56.712478 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:56.712478 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:56.712478 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:56.712478 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:56.712478 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.712478 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:56.713357 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:56.714661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1a344c0e-a484-4234-9187-4bdae666051d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.714661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:56.714661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:56.714661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:56.714661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:56.714661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:56.714661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:56.714661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:56.714661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:56.714661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:56.714661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:56.714661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:56.714661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:56.714661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:03:56.714661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:56.714661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.715336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:56.716141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:56.716141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.716141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4d2c9a67-f039-4057-a878-f3ca4d48758f None None] Traceback (most recent call last):
Apr 07 20:03:56.716141 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:56.716141 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:56.716141 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:56.716141 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:56.716141 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:56.716141 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.716141 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:56.716823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-4d2c9a67-f039-4057-a878-f3ca4d48758f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.716823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:56.716823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:56.716823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:56.716823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:56.716823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:56.716823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:56.716823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:56.716823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:56.716823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:56.716823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:56.716823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:56.716823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:56.716823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:03:56.716823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:03:56.716823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:56.716823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.717747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:56.718463 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:56.718463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.718463 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:03:56.718463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.718463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Traceback (most recent call last):
Apr 07 20:03:56.718463 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:56.718463 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:56.718463 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:56.718463 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:56.718463 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:56.718463 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.718463 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:56.719307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.719307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:56.719307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:56.719307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:56.719307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:56.719307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:56.719307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:56.719307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:56.719307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:56.719307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:56.719307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:56.719307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:56.719307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:56.719307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:56.719307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:56.720217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:56.720217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:56.720217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:56.720217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:56.720217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:56.720217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:56.720217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:56.720217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.720217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:56.720217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-88f76a9b-c455-4cbe-b92d-493994f641e7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.720217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:56.720217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:56.720217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:56.720217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:56.720217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:56.720802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.721546 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:03:56.722254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.722254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:03:56.722254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:56.722254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:56.722254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:56.722254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:56.722254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:56.722254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:56.722254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:56.722254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:03:56.722254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:56.722254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:03:56.722254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:56.722254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:03:56.722254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:03:56.722254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:56.722752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:03:56.722752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:56.722752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:03:56.722752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:03:56.722752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:56.722752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:03:56.722752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.722752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:03:56.723685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.723685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:03:56.723685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:03:56.723685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:03:56.723685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:03:56.723685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:03:56.723685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:56.723685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:03:56.723685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:03:56.723685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:03:56.723685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:03:56.723685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:03:56.723685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:03:56.723685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:03:56.723685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:03:56.723685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:03:56.724404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:03:56.725129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:03:56.725129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:03:56.725129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:01.189257 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:01.190559 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:01.221338 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:01.222011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.222742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:04:01.222742 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:01.222742 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:01.222742 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:01.222742 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:01.222742 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:01.222742 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.222742 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:01.223861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.223861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:01.223861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:01.223861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:01.223861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:01.223861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:01.223861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:01.223861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:01.223861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:01.223861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:01.223861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:01.223861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:01.223861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:01.223861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:04:01.223861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:01.223861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:01.223861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.224891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:01.648079 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:01.648418 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:01.649551 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:04:01.650141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:01.650504 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:01.650672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.651603 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:01.651866 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:01.652667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Traceback (most recent call last):
Apr 07 20:04:01.652667 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:01.652667 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:01.652667 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:01.652667 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:01.652667 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:01.652667 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.652667 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:01.655058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.655058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:01.655058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:01.655058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:01.655058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:01.655058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:01.655058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:01.655058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:01.655058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:01.655058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:01.655058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:01.655058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:01.655058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:01.655058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:04:01.655058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:01.655058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.655751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:01.656311 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:01.656311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.656311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:01.656311 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:01.656311 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:01.656311 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:01.656311 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:01.656311 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:01.656311 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.656311 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:01.657245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.657245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:01.657245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:01.657245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:01.657245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:01.657245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:01.657245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:01.657245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:01.657245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:01.657245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:01.657245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:01.657245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:01.657245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:01.657245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:01.657245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:01.657245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:01.657957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:01.657957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:01.657957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:01.657957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:01.657957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:01.657957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:01.657957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.657957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:01.657957 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:01.658647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.658647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:01.658647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:01.658647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:01.658647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:01.658647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:01.658647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:01.658647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:01.658647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:01.658647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:01.658647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:01.658647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:01.658647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:01.658647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:04:01.658647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:04:01.658647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:01.659262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:01.659947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:01.659947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.659947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:01.659947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.659947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Traceback (most recent call last):
Apr 07 20:04:01.659947 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:01.659947 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:01.659947 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:01.659947 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:01.659947 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:01.659947 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.659947 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:01.660457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.660457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:01.660457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:01.660457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:01.660457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:01.660457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:01.660457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:01.660457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:01.660457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:01.660457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:01.660457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:01.660457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:01.660457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:01.660457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:01.660457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:01.661265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:01.661265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:01.661265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:01.661265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:01.661265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:01.661265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:01.661265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:01.661265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.661265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:01.661265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.661265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:01.661265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:01.661265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:01.661265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:01.661265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:01.661936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:01.662686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:01.662686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:01.662686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:01.662686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:01.662686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:01.662686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:01.662686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:01.662686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:01.662686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:01.662686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:01.662686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.662686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:01.708697 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:01.708994 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:01.709765 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:01.758140 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:01.758140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.759318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:01.759318 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:01.759318 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:01.759318 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:01.759318 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:01.759318 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:01.759318 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.759318 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:01.760643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.760643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:01.760643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:01.760643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:01.760643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:01.760643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:01.760643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:01.760643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:01.760643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:01.760643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:01.760643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:01.760643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:01.760643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:01.760643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:04:01.760643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:01.760643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:01.760643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:01.761144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:06.190174 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:06.192158 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:06.224074 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:06.224267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.224892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:04:06.224892 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:06.224892 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:06.224892 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:06.224892 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:06.224892 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:06.224892 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.224892 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:06.225879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.225879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:06.225879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:06.225879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:06.225879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:06.225879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:06.225879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:06.225879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:06.225879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:06.225879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:06.225879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:06.225879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:06.225879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:06.225879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:04:06.225879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:06.225879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:06.225879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.226820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:06.649386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:06.649639 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:06.650705 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:04:06.651693 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:06.652223 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:06.652525 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:06.652899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.653817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:06.654808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Traceback (most recent call last):
Apr 07 20:04:06.654808 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:06.654808 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:06.654808 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:06.654808 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:06.654808 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:06.654808 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.654808 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:06.655160 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:06.657098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.657098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:06.657098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:06.657098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:06.657098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:06.657098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:06.657098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:06.657098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:06.657098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:06.657098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:06.657098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:06.657098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:06.657098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:06.657098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:04:06.657098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:06.657098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.657547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:06.658086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.658086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:06.658086 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:06.658086 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:06.658086 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:06.658086 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:06.658086 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:06.658086 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.658086 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:06.659649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.659649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:06.659649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:06.659649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:06.659649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:06.659649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:06.659649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:06.659649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:06.659649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:06.659649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:06.659649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:06.659649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:06.659649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:06.659649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:06.659649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:06.659649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:06.660172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:06.660172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:06.660172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:06.660172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:06.660172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:06.660172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:06.660172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.660172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:06.660172 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:06.661321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.661321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:06.661321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:06.661321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:06.661321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:06.661321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:06.661321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:06.661321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:06.661321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:06.661321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:06.661321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:06.661321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:06.661321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:06.661321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:04:06.661321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:04:06.661321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:06.661773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:06.662275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:06.662275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.662275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:06.662275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.662275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Traceback (most recent call last):
Apr 07 20:04:06.662275 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:06.662275 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:06.662275 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:06.662275 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:06.662275 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:06.662275 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.662275 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:06.663330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.663330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:06.663330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:06.663330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:06.663330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:06.663330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:06.663330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:06.663330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:06.663330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:06.663330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:06.663330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:06.663330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:06.663330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:06.663330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:06.663330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:06.663735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:06.663735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:06.663735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:06.663735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:06.663735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:06.663735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:06.663735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:06.663735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.663735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:06.665242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.665242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:06.665242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:06.665242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:06.665242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:06.665242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:06.665242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:06.665242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:06.665242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:06.665242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:06.665242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:06.665242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:06.665242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:06.665242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:04:06.665242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:04:06.665242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:06.665679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:06.666201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.666201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:06.709173 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:06.709874 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:06.710361 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:06.710740 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:06.711060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.711793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:06.711793 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:06.711793 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:06.711793 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:06.711793 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:06.711793 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:06.711793 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.711793 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:06.713321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.713321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:06.713321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:06.713321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:06.713321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:06.713321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:06.713321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:06.713321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:06.713321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:06.713321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:06.713321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:06.713321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:06.713321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:06.713321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:04:06.713321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:06.713321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:06.713321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:06.713860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:11.190799 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:11.192033 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:11.226429 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:11.226819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.228304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:04:11.228304 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:11.228304 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:11.228304 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:11.228304 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:11.228304 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:11.228304 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.228304 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:11.229495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.229495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:11.229495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:11.229495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:11.229495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:11.229495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:11.229495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:11.229495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:11.229495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:11.229495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:11.229495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:11.229495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:11.229495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:11.229495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:04:11.229495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:11.229495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:11.229495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.229976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:11.650348 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:11.650853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:11.651574 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:04:11.652459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:11.652771 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:11.653099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.654266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Traceback (most recent call last):
Apr 07 20:04:11.654266 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:11.654266 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:11.654266 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:11.654266 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:11.654266 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:11.654266 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.654266 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:11.656716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.656716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:11.656716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:11.656716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:11.656716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:11.656716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:11.656716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:11.656716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:11.656716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:11.656716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:11.656716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:11.656716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:11.656716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:11.656716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:04:11.656716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:11.656716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.657257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:11.658132 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:11.658447 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:11.659247 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:11.659517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.660118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:11.660118 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:11.660118 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:11.660118 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:11.660118 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:11.660118 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:11.660118 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.660118 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:11.661405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.661405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:11.661405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:11.661405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:11.661405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:11.661405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:11.661405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:11.661405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:11.661405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:11.661405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:11.661405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:11.661405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:11.661405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:11.661405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:11.661405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:11.661405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:11.661972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:11.661972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:11.661972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:11.661972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:11.661972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:11.661972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:11.661972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.661972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:11.661972 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:11.663257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.663257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:11.663257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:11.663257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:11.663257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:11.663257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:11.663257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:11.663257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:11.663257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:11.663257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:11.663257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:11.663257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:11.663257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:11.663257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:04:11.663257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:04:11.663257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:11.663756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:11.664249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:11.664249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.664249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:11.664249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.664249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Traceback (most recent call last):
Apr 07 20:04:11.664249 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:11.664249 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:11.664249 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:11.664249 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:11.664249 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:11.664249 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.664249 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:11.664966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.664966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:11.664966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:11.664966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:11.664966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:11.664966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:11.664966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:11.664966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:11.664966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:11.664966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:11.664966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:11.664966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:11.664966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:11.664966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:11.664966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:11.665435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:11.665435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:11.665435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:11.665435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:11.665435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:11.665435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:11.665435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:11.665435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.665435 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:11.666192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.666192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:11.666192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:11.666192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:11.666192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:11.666192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:11.666192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:11.666192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:11.666192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:11.666192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:11.666192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:11.666192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:11.666192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:11.666192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:04:11.666192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:04:11.666192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:11.666725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:11.667339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.667339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:11.710105 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:11.710633 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:11.711174 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:11.711380 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:11.711487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.712314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:11.712314 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:11.712314 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:11.712314 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:11.712314 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:11.712314 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:11.712314 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.712314 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:11.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:11.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:11.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:11.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:11.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:11.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:11.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:11.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:11.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:11.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:11.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:11.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:11.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:04:11.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:11.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:11.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:11.714705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:16.191700 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:16.194163 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:16.233555 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:16.234121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.235229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:04:16.235229 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:16.235229 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:16.235229 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:16.235229 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:16.235229 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:16.235229 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.235229 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:16.236629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.236629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:16.236629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:16.236629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:16.236629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:16.236629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:16.236629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:16.236629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:16.236629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:16.236629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:16.236629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:16.236629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:16.236629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:16.236629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:04:16.236629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:16.236629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:16.236629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.237754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:16.650953 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:16.651948 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:16.652861 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:04:16.653454 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:16.653938 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:16.654232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.655230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:16.655230 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:16.655230 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:16.655230 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:16.655230 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:16.655230 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:16.655230 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.655230 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:16.655670 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:16.657503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.657503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:16.657503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:16.657503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:16.657503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:16.657503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:16.657503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:16.657503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:16.657503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:16.657503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:16.657503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:16.657503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:16.657503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:16.657503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:04:16.657503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:16.657503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:16.657503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.658407 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:16.659395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.659395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Traceback (most recent call last):
Apr 07 20:04:16.659395 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:16.659395 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:16.659395 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:16.659395 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:16.659395 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:16.659395 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.659395 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:16.660012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.660012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:16.660012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:16.660012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:16.660012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:16.660012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:16.660012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:16.660012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:16.660012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:16.660012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:16.660012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:16.660012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:16.660012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:16.660012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:16.660012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:16.660765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:16.660765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:16.660765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:16.660765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:16.660765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:16.660765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:16.660765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:16.660765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.660765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:16.660765 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:16.661820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.661820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:16.661820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:16.661820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:16.661820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:16.661820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:16.661820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:16.661820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:16.661820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:16.661820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:16.661820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:16.661820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:16.661820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:16.661820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:04:16.661820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:04:16.661820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:16.662639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:16.663377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:16.663377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.663377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:16.663377 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:16.663377 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:16.663377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.664045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Traceback (most recent call last):
Apr 07 20:04:16.664045 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:16.664045 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:16.664045 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:16.664045 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:16.664045 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:16.664045 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.664045 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:16.665236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.665236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:16.665236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:16.665236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:16.665236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:16.665236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:16.665236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:16.665236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:16.665236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:16.665236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:16.665236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:16.665236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:16.665236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:16.665236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:16.665236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:16.665633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:16.665633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:16.665633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:16.665633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:16.665633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:16.665633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:16.665633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:16.665633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.665633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:16.667247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.667247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:16.667247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:16.667247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:16.667247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:16.667247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:16.667247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:16.667247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:16.667247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:16.667247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:16.667247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:16.667247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:16.667247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:16.667247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:04:16.667247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:04:16.667247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:16.667756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:16.668311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.668311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:16.710660 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:16.711341 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:16.712117 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:16.712584 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:16.712894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.713799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:16.713799 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:16.713799 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:16.713799 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:16.713799 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:16.713799 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:16.713799 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.713799 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:16.715806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.715806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:16.715806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:16.715806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:16.715806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:16.715806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:16.715806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:16.715806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:16.715806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:16.715806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:16.715806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:16.715806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:16.715806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:16.715806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:04:16.715806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:16.715806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:16.715806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:16.716494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:21.192315 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:21.193508 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:21.195090 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=240 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:04:21.244583 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:21.244813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.245483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:04:21.245483 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:21.245483 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:21.245483 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:21.245483 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:21.245483 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:21.245483 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.245483 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:21.247404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.247404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:21.247404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:21.247404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:21.247404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:21.247404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:21.247404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:21.247404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:21.247404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:21.247404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:21.247404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:21.247404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:21.247404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:21.247404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:04:21.247404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:21.247404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:21.247404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.247953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:21.651621 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:21.652606 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:21.653201 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:21.653601 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:21.654003 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:04:21.657441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.657848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:21.657848 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:21.657848 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:21.657848 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:21.657848 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:21.657848 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:21.657848 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.657848 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:21.658338 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:21.659272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.659272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:21.659272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:21.659272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:21.659272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:21.659272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:21.659272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:21.659272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:21.659272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:21.659272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:21.659272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:21.659272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:21.659272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:21.659272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:04:21.659272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:21.659272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:21.659272 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.660276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:21.660800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.661246 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:21.661246 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:21.661727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Traceback (most recent call last):
Apr 07 20:04:21.661727 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:21.661727 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:21.661727 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:21.661727 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:21.661727 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:21.661727 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.661727 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:21.662689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.662689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:21.662689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:21.662689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:21.662689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:21.662689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:21.662689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:21.662689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:21.662689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:21.662689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:21.662689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:21.662689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:21.662689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:21.662689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:21.662689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:21.663965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:21.663965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:21.663965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:21.663965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:21.663965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:21.663965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:21.663965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:21.663965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.663965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:21.663965 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:21.663965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-86d12cbc-9788-4911-bb4c-f232d0b3500f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.663965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:21.664400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:21.665421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Traceback (most recent call last):
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:21.665916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:21.668099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:21.668099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:21.668099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:21.668099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:21.668099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:21.668099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:21.668099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:21.668099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:21.668099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:21.668099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:21.668099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:21.668099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:21.668099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.668099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:21.669211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-269b25b2-ab00-47f6-b19c-3f8457095fe3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.669211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:21.669211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:21.669211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:21.669211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:21.669211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:21.669211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:21.669211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:21.669211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:21.669211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:21.669211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:21.669211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:21.669211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:21.669211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:04:21.669211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:04:21.669211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:21.670381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:21.672022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.672022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:21.712047 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:21.713152 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:21.713367 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:21.713590 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:21.713693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.714247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:21.714247 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:21.714247 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:21.714247 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:21.714247 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:21.714247 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:21.714247 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.714247 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:21.715468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.715468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:21.715468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:21.715468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:21.715468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:21.715468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:21.715468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:21.715468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:21.715468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:21.715468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:21.715468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:21.715468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:21.715468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:21.715468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:04:21.715468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:21.715468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:21.715468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:21.716410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:26.192839 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:26.195559 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:26.229886 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:26.230190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:26.231704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:26.232423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:26.233629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:26.233629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:26.233629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:26.233629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:26.233629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.233629 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:26.652242 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:26.654192 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:26.654432 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:26.654671 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:26.654769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.655327 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:04:26.657492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:04:26.657492 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:26.657492 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:26.657492 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:26.657492 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:26.657492 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:26.657492 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.657492 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:26.658108 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:26.660242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.660242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:26.660242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:26.660242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:26.660242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:26.660242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:26.660242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:26.660242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:26.660242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:26.660242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:26.660242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:26.660242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:26.660242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:26.660242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:04:26.660242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:26.660242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.661227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:26.661732 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:26.661777 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:26.662538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.662754 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:26.663044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.663496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:26.663496 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:26.663496 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:26.663496 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:26.663496 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:26.663496 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:26.663496 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.663496 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:26.664341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.664341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:26.664341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:26.664341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:26.664341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:26.664341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:26.664341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:26.664341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:26.664341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:26.664341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:26.664341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:26.664341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:26.664341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:26.664341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:26.664341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:26.664341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:26.664869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:26.664869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:26.664869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:26.664869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:26.664869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:26.664869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:26.664869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.664869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:26.665523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.665523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:26.665523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:26.665523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:26.665523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:26.665523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:26.665523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:26.665523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:26.665523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:26.665523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:26.665523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:26.665523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:26.665523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:26.665523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:04:26.665523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:04:26.665523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:26.665979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:26.666484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:26.666484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.666484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:26.666484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:04:26.666484 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:26.666484 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:26.666484 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:26.666484 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:26.666484 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:26.666484 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.666484 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:26.666803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.666803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:26.666803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:26.666803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:26.666803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:26.666803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:26.666803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:26.666803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:26.666803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:26.666803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:26.666803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:26.666803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:26.666803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:26.666803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:26.666803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:26.667211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:26.667211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:26.667211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:26.667211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:26.667211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:26.667211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:26.667211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:26.667211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.667211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:26.668516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.668516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:26.668516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:26.668516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:26.668516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:26.668516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:26.668516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:26.668516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:26.668516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:26.668516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:26.668516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:26.668516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:26.668516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:26.668516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:04:26.668516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:04:26.668516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:26.670143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:26.671711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.671711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:26.713060 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:26.713675 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:26.714184 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:26.714566 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:26.714823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.715790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:26.715790 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:26.715790 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:26.715790 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:26.715790 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:26.715790 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:26.715790 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.715790 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:26.717675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.717675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:26.717675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:26.717675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:26.717675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:26.717675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:26.717675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:26.717675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:26.717675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:26.717675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:26.717675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:26.717675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:26.717675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:26.717675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:04:26.717675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:26.717675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:26.717675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:26.718252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:31.194306 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:31.196071 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:31.233636 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:31.234014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.234748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:04:31.234748 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:31.234748 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:31.234748 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:31.234748 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:31.234748 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:31.234748 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.234748 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:31.235506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.235506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:31.235506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:31.235506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:31.235506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:31.235506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:31.235506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:31.235506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:31.235506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:31.235506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:31.235506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:31.235506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:31.235506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:31.235506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:04:31.235506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:31.235506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:31.235506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.236320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:31.653627 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:31.655139 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:31.655523 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:31.655663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.656255 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:31.657402 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:04:31.657692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:04:31.657692 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:31.657692 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:31.657692 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:31.657692 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:31.657692 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:31.657692 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.657692 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:31.659294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.659294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:31.659294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:31.659294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:31.659294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:31.659294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:31.659294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:31.659294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:31.659294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:31.659294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:31.659294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:31.659294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:31.659294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:31.659294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:04:31.659294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:31.659294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.660481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:31.661494 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:31.661494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.661494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:31.661494 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:31.661494 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:31.661494 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:31.661494 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:31.661494 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:31.661494 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.661494 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:31.662063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.662063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:31.662063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:31.662063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:31.662063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:31.662063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:31.662063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:31.662063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:31.662063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:31.662063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:31.662063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:31.662063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:31.662063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:31.662063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:31.662063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:31.662063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:31.663022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:31.663022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:31.663022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:31.663022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:31.663022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:31.663022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:31.663022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.663022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:31.663022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.663022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:31.663022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:31.663022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:31.663022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:31.663022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:31.663022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:31.663022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:31.664095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:31.664614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:31.664614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:31.664614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:31.664614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:31.664614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:31.664614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:31.664614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:31.664614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:31.664614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:31.664614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.664614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:31.664614 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:31.664614 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:31.664971 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:31.665183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.666165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:31.666165 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:31.666165 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:31.666165 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:31.666165 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:31.666165 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:31.666165 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.666165 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:31.666939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.666939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:31.666939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:31.666939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:31.666939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:31.666939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:31.666939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:31.666939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:31.666939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:31.666939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:31.666939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:31.666939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:31.666939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:31.666939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:31.666939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:31.666939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:31.667706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:31.667706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:31.667706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:31.667706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:31.667706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:31.667706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:31.667706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.667706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:31.668015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.668015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:31.668015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:31.668015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:31.668015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:31.668015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:31.668015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:31.668015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:31.668015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:31.668015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:31.668015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:31.668015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:31.668015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:31.668015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:04:31.668015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:04:31.668015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:31.668475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:31.669045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.669045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:31.713941 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:31.714581 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:31.715206 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:31.715509 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:31.715650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.716477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:31.716477 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:31.716477 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:31.716477 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:31.716477 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:31.716477 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:31.716477 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.716477 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:31.717741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.717741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:31.717741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:31.717741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:31.717741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:31.717741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:31.717741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:31.717741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:31.717741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:31.717741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:31.717741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:31.717741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:31.717741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:31.717741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:04:31.717741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:31.717741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:31.717741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:31.718677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:36.195039 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:36.196794 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:36.236386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:36.236825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.237894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:04:36.237894 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:36.237894 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:36.237894 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:36.237894 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:36.237894 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:36.237894 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.237894 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:36.239176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.239176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:36.239176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:36.239176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:36.239176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:36.239176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:36.239176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:36.239176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:36.239176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:36.239176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:36.239176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:36.239176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:36.239176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:36.239176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:04:36.239176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:36.239176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:36.239176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.239805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:36.654443 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:36.655730 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:36.656123 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:36.656504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.657575 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:36.658382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:04:36.658382 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:36.658382 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:36.658382 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:36.658382 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:36.658382 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:36.658382 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.658382 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:36.659159 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:04:36.661388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.661388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:36.661388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:36.661388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:36.661388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:36.661388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:36.661388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:36.661388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:36.661388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:36.661388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:36.661388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:36.661388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:36.661388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:36.661388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:04:36.661388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:36.661388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.662634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:36.663687 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:36.663687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.663687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:36.663687 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:36.663687 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:36.663687 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:36.663687 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:36.663687 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:36.663687 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.663687 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:36.664255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.664255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:36.664255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:36.664255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:36.664255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:36.664255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:36.664255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:36.664255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:36.664255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:36.664255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:36.664255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:36.664255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:36.664255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:36.664255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:36.664255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:36.664255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:36.665361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:36.665361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:36.665361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:36.665361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:36.665361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:36.665361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:36.665361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.665361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:36.665856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.665856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:36.665856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:36.665856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:36.665856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:36.665856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:36.665856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:36.665856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:36.665856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:36.665856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:36.665856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:36.665856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:36.665856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:36.665856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:04:36.665856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:04:36.665856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:36.666894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:36.667720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:36.667720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.667720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:36.667720 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:36.667720 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:36.667720 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:36.667720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.667720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:36.667720 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:36.667720 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:36.667720 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:36.667720 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:36.667720 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:36.668217 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.668217 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:36.669087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.669087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:36.669087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:36.669087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:36.669087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:36.669087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:36.669087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:36.669087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:36.669087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:36.669087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:36.669087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:36.669087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:36.669087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:36.669087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:36.669087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:36.669087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:36.669685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:36.669685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:36.669685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:36.669685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:36.669685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:36.669685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:36.669685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.669685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:36.671399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.671399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:36.671399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:36.671399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:36.671399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:36.671399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:36.671399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:36.671399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:36.671399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:36.671399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:36.671399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:36.671399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:36.671399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:36.671399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:04:36.671399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:04:36.671399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:36.671792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:36.672164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.672164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:36.714610 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:36.715078 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:36.715705 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:36.716128 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:36.716365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.717204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:36.717204 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:36.717204 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:36.717204 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:36.717204 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:36.717204 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:36.717204 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.717204 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:36.719269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.719269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:36.719269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:36.719269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:36.719269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:36.719269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:36.719269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:36.719269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:36.719269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:36.719269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:36.719269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:36.719269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:36.719269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:36.719269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:04:36.719269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:36.719269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:36.719269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:36.720101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:41.195750 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:41.197635 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:41.238780 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:41.239409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.240901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:04:41.240901 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:41.240901 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:41.240901 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:41.240901 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:41.240901 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:41.240901 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.240901 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:41.242894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.242894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:41.242894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:41.242894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:41.242894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:41.242894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:41.242894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:41.242894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:41.242894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:41.242894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:41.242894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:41.242894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:41.242894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:41.242894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:04:41.242894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:41.242894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:41.242894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.243847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:41.655035 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:41.656222 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:41.656485 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:41.656708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.657655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:04:41.657655 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:41.657655 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:41.657655 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:41.657655 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:41.657655 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:41.657655 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.657655 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:41.659281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.659281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:41.659281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:41.659281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:41.659281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:41.659281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:41.659281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:41.659281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:41.659281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:41.659281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:41.659281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:41.659281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:41.659281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:41.659281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:04:41.659281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:41.659281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.659890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:41.660386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:41.660611 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:04:41.661004 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:41.661291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.662015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:04:41.662015 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:41.662015 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:41.662015 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:41.662015 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:41.662015 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:41.662015 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.662015 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:41.663650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.663650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:41.663650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:41.663650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:41.663650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:41.663650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:41.663650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:41.663650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:41.663650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:41.663650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:41.663650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:41.663650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:41.663650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:41.663650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:41.663650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:41.664294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:41.664294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:41.664294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:41.664294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:41.664294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:41.664294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:41.664294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:41.664294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.664294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:41.665525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.665525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:41.665525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:41.665525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:41.665525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:41.665525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:41.665525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:41.665525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:41.665525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:41.665525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:41.665525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:41.665525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:41.665525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:41.665525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:04:41.665525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:04:41.665525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:41.665965 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:41.666467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:41.666467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.666467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:41.666467 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:41.666592 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:41.666948 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:41.667389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.668041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:41.668041 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:41.668041 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:41.668041 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:41.668041 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:41.668041 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:41.668041 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.668041 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:41.668737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.668737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:41.668737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:41.668737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:41.668737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:41.668737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:41.668737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:41.668737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:41.668737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:41.668737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:41.668737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:41.668737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:41.668737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:41.668737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:41.668737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:41.668737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:41.669255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:41.669255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:41.669255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:41.669255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:41.669255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:41.669255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:41.669255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.669255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:41.669708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.669708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:41.669708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:41.669708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:41.669708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:41.669708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:41.669708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:41.669708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:41.669708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:41.669708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:41.669708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:41.669708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:41.669708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:41.669708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:04:41.669708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:04:41.669708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:41.670175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:41.670655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.670655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:41.715328 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:41.715750 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:41.716443 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:41.716961 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:41.717273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.718108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:41.718108 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:41.718108 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:41.718108 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:41.718108 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:41.718108 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:41.718108 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.718108 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:41.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:41.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:41.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:41.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:41.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:41.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:41.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:41.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:41.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:41.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:41.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:41.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:41.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:04:41.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:41.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:41.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:41.719931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:46.198426 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:46.200179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:46.232311 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:46.232803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.233682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:04:46.233682 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:46.233682 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:46.233682 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:46.233682 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:46.233682 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:46.233682 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.233682 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:46.234530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.234530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:46.234530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:46.234530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:46.234530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:46.234530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:46.234530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:46.234530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:46.234530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:46.234530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:46.234530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:46.234530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:46.234530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:46.234530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:04:46.234530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:46.234530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:46.234530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.235019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:46.655966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:46.657228 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:46.657697 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:46.658049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.659109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:04:46.659109 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:46.659109 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:46.659109 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:46.659109 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:46.659109 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:46.659109 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.659109 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:46.660319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.660319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:46.660319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:46.660319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:46.660319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:46.660319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:46.660319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:46.660319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:46.660319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:46.660319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:46.660319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:46.660319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:46.660319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:46.660319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:04:46.660319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:46.660319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.660814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:46.661321 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:46.661752 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:04:46.662206 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:46.662518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.663443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:04:46.663443 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:46.663443 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:46.663443 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:46.663443 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:46.663443 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:46.663443 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.663443 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:46.664735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.664735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:46.664735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:46.664735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:46.664735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:46.664735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:46.664735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:46.664735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:46.664735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:46.664735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:46.664735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:46.664735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:46.664735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:46.664735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:46.664735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:46.665725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:46.665725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:46.665725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:46.665725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:46.665725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:46.665725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:46.665725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:46.665725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.665725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:46.666399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.666399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:46.666399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:46.666399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:46.666399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:46.666399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:46.666399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:46.666399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:46.666399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:46.666399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:46.666399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:46.666399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:46.666399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:46.666399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:04:46.666399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:04:46.666399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:46.667003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:46.667693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:46.667693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.667693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:46.667693 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:46.667693 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:46.667693 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:46.667948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.668385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:46.668385 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:46.668385 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:46.668385 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:46.668385 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:46.668385 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:46.668385 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.668385 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:46.669879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.669879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:46.669879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:46.669879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:46.669879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:46.669879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:46.669879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:46.669879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:46.669879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:46.669879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:46.669879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:46.669879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:46.669879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:46.669879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:46.669879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:46.669879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:46.670483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:46.670483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:46.670483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:46.670483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:46.670483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:46.670483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:46.670483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.670483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:46.671078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.671078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:46.671078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:46.671078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:46.671078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:46.671078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:46.671078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:46.671078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:46.671078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:46.671078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:46.671078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:46.671078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:46.671078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:46.671078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:04:46.671078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:04:46.671078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:46.671663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:46.672463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.672463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:46.715927 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:46.716294 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:46.716930 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:46.717451 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:46.717820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.718824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:46.718824 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:46.718824 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:46.718824 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:46.718824 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:46.718824 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:46.718824 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.718824 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:46.719917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.719917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:46.719917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:46.719917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:46.719917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:46.719917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:46.719917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:46.719917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:46.719917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:46.719917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:46.719917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:46.719917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:46.719917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:46.719917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:04:46.719917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:46.719917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:46.719917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:46.720941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:51.199106 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:51.200705 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:51.236539 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:51.236797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.237492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:04:51.237492 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:51.237492 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:51.237492 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:51.237492 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:51.237492 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:51.237492 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.237492 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:51.238688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.238688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:51.238688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:51.238688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:51.238688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:51.238688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:51.238688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:51.238688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:51.238688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:51.238688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:51.238688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:51.238688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:51.238688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:51.238688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:04:51.238688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:51.238688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:51.238688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.239661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:51.656705 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:51.658310 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:51.658735 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:51.659135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.660680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:04:51.660680 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:51.660680 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:51.660680 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:51.660680 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:51.660680 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:51.660680 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.660680 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:51.663429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.663429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:51.663429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:51.663429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:51.663429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:51.663429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:51.663429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:51.663429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:51.663429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:51.663429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:51.663429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:51.663429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:51.663429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:51.663429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:04:51.663429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:51.663429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.664683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:51.666032 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:51.666032 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:04:51.666032 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:51.666032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.666032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:04:51.666032 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:51.666032 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:51.666032 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:51.666032 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:51.666032 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:51.666032 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.666032 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:51.667038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.667038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:51.667038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:51.667038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:51.667038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:51.667038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:51.667038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:51.667038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:51.667038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:51.667038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:51.667038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:51.667038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:51.667038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:51.667038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:51.667038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:51.667542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:51.667542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:51.667542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:51.667542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:51.667542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:51.667542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:51.667542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:51.667542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.667542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:51.667542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.667542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:51.667542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:51.667542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:51.667542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:51.667542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:51.668035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:51.668646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:51.668646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:51.668646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:51.668646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:51.668646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:51.668646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:51.668646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:51.668646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:51.668646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:51.668646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:51.668646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:51.668646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.668646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:51.668646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:51.668646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:51.669095 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:51.669095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.669095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:51.669095 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:51.669095 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:51.669095 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:51.669095 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:51.669095 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:51.669095 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.669095 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:51.669566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.669566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:51.669566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:51.669566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:51.669566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:51.669566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:51.669566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:51.669566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:51.669566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:51.669566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:51.669566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:51.669566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:51.669566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:51.669566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:51.669566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:51.669566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:51.670217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:51.670217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:51.670217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:51.670217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:51.670217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:51.670217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:51.670217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.670217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:51.670433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.670433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:51.670433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:51.670433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:51.670433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:51.670433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:51.670433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:51.670433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:51.670433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:51.670433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:51.670433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:51.670433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:51.670433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:51.670433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:04:51.670433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:04:51.670433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:51.671159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:51.671513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.671513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:51.716660 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:51.717260 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:51.718100 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:51.718562 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:51.718912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.719669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:51.719669 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:51.719669 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:51.719669 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:51.719669 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:51.719669 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:51.719669 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.719669 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:51.721583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.721583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:51.721583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:51.721583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:51.721583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:51.721583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:51.721583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:51.721583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:51.721583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:51.721583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:51.721583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:51.721583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:51.721583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:51.721583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:04:51.721583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:51.721583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:51.721583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:51.722594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:56.199948 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:56.201829 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:56.231178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:56.231498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.232224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:04:56.232224 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:56.232224 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:56.232224 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:56.232224 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:56.232224 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:56.232224 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.232224 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:56.232956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.232956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:56.232956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:56.232956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:56.232956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:56.232956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:56.232956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:56.232956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:56.232956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:56.232956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:56.232956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:56.232956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:56.232956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:56.232956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:04:56.232956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:56.232956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:56.232956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.234067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:56.657515 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:56.658871 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:56.659317 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:56.659572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.660622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:04:56.660622 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:56.660622 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:56.660622 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:56.660622 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:56.660622 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:56.660622 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.660622 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:56.662633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.662633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:56.662633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:56.662633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:56.662633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:56.662633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:56.662633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:56.662633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:56.662633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:56.662633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:56.662633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:56.662633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:56.662633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:56.662633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:04:56.662633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:56.662633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.663538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:56.664419 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:56.664419 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:04:56.664689 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:56.664896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.665419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:04:56.665419 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:56.665419 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:56.665419 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:56.665419 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:56.665419 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:56.665419 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.665419 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:56.666196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.666196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:56.666196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:56.666196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:56.666196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:56.666196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:56.666196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:56.666196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:56.666196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:56.666196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:56.666196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:56.666196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:56.666196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:56.666196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:56.666196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:56.666907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:56.666907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:56.666907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:56.666907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:56.666907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:56.666907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:56.666907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:56.666907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.666907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:56.667354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.667354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:56.667354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:56.667354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:56.667354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:56.667354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:56.667354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:56.667354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:56.667354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:56.667354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:56.667354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:56.667354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:56.667354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:56.667354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:04:56.667354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:04:56.667354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:56.667794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:56.668296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:56.668296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.668296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:56.668296 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:56.668296 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:56.668954 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:56.669416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.670328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:56.670328 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:56.670328 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:56.670328 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:56.670328 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:56.670328 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:56.670328 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.670328 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:56.671735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.671735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:04:56.671735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:56.671735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:56.671735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:56.671735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:56.671735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:56.671735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:56.671735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:56.671735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:04:56.671735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:56.671735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:04:56.671735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:56.671735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:04:56.671735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:04:56.671735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:56.672213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:04:56.672213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:56.672213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:04:56.672213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:04:56.672213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:56.672213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:04:56.672213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.672213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:04:56.673606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.673606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:56.673606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:56.673606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:56.673606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:56.673606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:56.673606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:56.673606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:56.673606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:56.673606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:56.673606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:56.673606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:56.673606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:56.673606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:04:56.673606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:04:56.673606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:56.674081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:56.674604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.674604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:04:56.717333 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:04:56.717954 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:04:56.718808 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:56.719235 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:04:56.719804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.720952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:04:56.720952 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:56.720952 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:04:56.720952 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:04:56.720952 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:56.720952 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:04:56.720952 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.720952 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:04:56.723770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.723770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:04:56.723770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:04:56.723770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:04:56.723770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:04:56.723770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:04:56.723770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:56.723770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:04:56.723770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:04:56.723770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:04:56.723770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:04:56.723770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:04:56.723770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:04:56.723770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:04:56.723770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:04:56.723770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:56.723770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:04:56.724896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:01.200651 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:01.201696 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:01.237296 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:01.237640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.238379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:05:01.238379 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:01.238379 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:01.238379 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:01.238379 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:01.238379 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:01.238379 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.238379 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:01.239307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.239307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:01.239307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:01.239307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:01.239307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:01.239307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:01.239307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:01.239307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:01.239307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:01.239307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:01.239307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:01.239307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:01.239307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:01.239307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:05:01.239307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:01.239307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:01.239307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.239890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:01.658060 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:01.659414 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:01.659683 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:01.659845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.660966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:05:01.660966 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:01.660966 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:01.660966 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:01.660966 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:01.660966 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:01.660966 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.660966 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:01.663118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.663118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:01.663118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:01.663118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:01.663118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:01.663118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:01.663118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:01.663118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:01.663118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:01.663118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:01.663118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:01.663118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:01.663118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:01.663118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:05:01.663118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:01.663118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.663739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:01.664503 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:01.664775 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:05:01.665264 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:01.665473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.666160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:05:01.666160 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:01.666160 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:01.666160 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:01.666160 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:01.666160 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:01.666160 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.666160 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:01.666974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.666974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:01.666974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:01.666974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:01.666974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:01.666974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:01.666974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:01.666974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:01.666974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:01.666974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:01.666974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:01.666974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:01.666974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:01.666974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:01.666974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:01.667509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:01.667509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:01.667509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:01.667509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:01.667509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:01.667509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:01.667509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:01.667509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.667509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:01.667935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.667935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:01.667935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:01.667935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:01.667935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:01.667935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:01.667935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:01.667935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:01.667935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:01.667935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:01.667935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:01.667935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:01.667935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:01.667935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:05:01.667935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:05:01.667935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:01.668478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:01.669049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:01.669049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.669049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:01.669049 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:01.669049 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:01.669049 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:01.669373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.670029 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:01.670029 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:01.670029 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:01.670029 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:01.670029 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:01.670029 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:01.670029 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.670029 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:01.671171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.671171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:01.671171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:01.671171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:01.671171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:01.671171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:01.671171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:01.671171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:01.671171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:01.671171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:01.671171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:01.671171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:01.671171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:01.671171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:01.671171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:01.671171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:01.671651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:01.671651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:01.671651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:01.671651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:01.671651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:01.671651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:01.671651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.671651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:01.672875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.672875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:01.672875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:01.672875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:01.672875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:01.672875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:01.672875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:01.672875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:01.672875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:01.672875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:01.672875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:01.672875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:01.672875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:01.672875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:05:01.672875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:05:01.672875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:01.673378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:01.673884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.673884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:01.717930 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:01.718624 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:01.719357 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:01.719658 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:01.719827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.721054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:01.721054 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:01.721054 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:01.721054 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:01.721054 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:01.721054 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:01.721054 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.721054 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:01.722205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.722205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:01.722205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:01.722205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:01.722205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:01.722205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:01.722205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:01.722205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:01.722205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:01.722205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:01.722205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:01.722205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:01.722205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:01.722205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:05:01.722205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:01.722205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:01.722205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:01.722617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:06.201634 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:06.202621 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:06.235681 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:06.236123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.237010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:05:06.237010 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:06.237010 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:06.237010 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:06.237010 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:06.237010 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:06.237010 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.237010 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:06.237950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.237950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:06.237950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:06.237950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:06.237950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:06.237950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:06.237950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:06.237950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:06.237950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:06.237950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:06.237950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:06.237950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:06.237950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:06.237950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:05:06.237950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:06.237950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:06.237950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.238955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:06.659024 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:06.660356 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:06.660686 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:06.660908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.661644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:06.661644 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:06.661644 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:06.661644 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:06.661644 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:06.661644 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:06.661644 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.661644 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:06.662467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.662467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:06.662467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:06.662467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:06.662467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:06.662467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:06.662467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:06.662467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:06.662467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:06.662467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:06.662467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:06.662467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:06.662467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:06.662467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:05:06.662467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:06.662467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:06.662467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.663464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:06.665201 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:06.666057 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:05:06.666709 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:06.666905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.667813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:06.667813 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:06.667813 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:06.667813 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:06.667813 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:06.667813 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:06.667813 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.667813 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:06.669410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.669410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:06.669410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:06.669410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:06.669410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:06.669410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:06.669410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:06.669410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:06.669410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:06.669410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:06.669410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:06.669410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:06.669410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:06.669410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:06.669410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:06.669410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:06.670196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:06.670196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:06.670196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:06.670196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:06.670196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:06.670196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:06.670196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.670196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:06.670786 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:06.672211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.672211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:06.672211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:06.672211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:06.672211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:06.672211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:06.672211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:06.672211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:06.672211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:06.672211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:06.672211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:06.672211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:06.672211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:06.672211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:05:06.672211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:05:06.672211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:06.672866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:06.673593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:06.673593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.673593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:06.673593 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:06.673593 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:06.673593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.674400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:06.674400 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:06.674400 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:06.674400 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:06.674400 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:06.674400 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:06.674400 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.674400 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:06.675382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.675382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:06.675382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:06.675382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:06.675382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:06.675382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:06.675382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:06.675382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:06.675382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:06.675382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:06.675382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:06.675382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:06.675382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:06.675382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:06.675382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:06.675382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:06.675712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:06.675712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:06.675712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:06.675712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:06.675712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:06.675712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:06.675712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.675712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:06.677143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.677143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:06.677143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:06.677143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:06.677143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:06.677143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:06.677143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:06.677143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:06.677143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:06.677143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:06.677143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:06.677143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:06.677143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:06.677143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:05:06.677143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:05:06.677143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:06.677889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:06.678495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.678495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:06.719387 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:06.720194 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:06.721194 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:06.721818 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:06.722214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.722909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:06.722909 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:06.722909 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:06.722909 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:06.722909 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:06.722909 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:06.722909 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.722909 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:06.724260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.724260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:06.724260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:06.724260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:06.724260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:06.724260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:06.724260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:06.724260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:06.724260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:06.724260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:06.724260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:06.724260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:06.724260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:06.724260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:05:06.724260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:06.724260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:06.724260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:06.724851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:11.202431 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:11.203817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:11.234509 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:11.234859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.235721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:05:11.235721 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:11.235721 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:11.235721 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:11.235721 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:11.235721 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:11.235721 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.235721 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:11.236649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.236649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:11.236649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:11.236649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:11.236649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:11.236649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:11.236649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:11.236649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:11.236649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:11.236649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:11.236649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:11.236649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:11.236649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:11.236649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:05:11.236649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:11.236649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:11.236649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.237077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:11.659773 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:11.661531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:11.661772 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:11.662388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.663067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:11.663067 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:11.663067 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:11.663067 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:11.663067 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:11.663067 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:11.663067 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.663067 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:11.664941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.664941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:11.664941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:11.664941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:11.664941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:11.664941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:11.664941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:11.664941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:11.664941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:11.664941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:11.664941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:11.664941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:11.664941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:11.664941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:05:11.664941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:11.664941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:11.664941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.665877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:11.666750 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:11.666750 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:05:11.666750 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:11.666951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.667526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:11.667526 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:11.667526 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:11.667526 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:11.667526 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:11.667526 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:11.667526 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.667526 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:11.668832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.668832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:11.668832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:11.668832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:11.668832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:11.668832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:11.668832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:11.668832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:11.668832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:11.668832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:11.668832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:11.668832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:11.668832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:11.668832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:11.668832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:11.668832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:11.669465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:11.669465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:11.669465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:11.669465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:11.669465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:11.669465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:11.669465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.669465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:11.670552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.670552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:11.670552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:11.670552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:11.670552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:11.670552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:11.670552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:11.670552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:11.670552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:11.670552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:11.670552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:11.670552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:11.670552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:11.670552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:05:11.670552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:05:11.670552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:11.671067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:11.671644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:11.671644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.671644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:11.671644 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:11.672253 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:11.672793 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:11.673264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.674223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:05:11.674223 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:11.674223 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:11.674223 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:11.674223 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:11.674223 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:11.674223 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.674223 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:11.675208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.675208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:11.675208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:11.675208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:11.675208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:11.675208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:11.675208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:11.675208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:11.675208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:11.675208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:11.675208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:11.675208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:11.675208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:11.675208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:11.675208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:11.675655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:11.675655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:11.675655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:11.675655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:11.675655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:11.675655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:11.675655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:11.675655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.675655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:11.676417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.676417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:11.676417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:11.676417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:11.676417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:11.676417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:11.676417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:11.676417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:11.676417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:11.676417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:11.676417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:11.676417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:11.676417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:11.676417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:05:11.676417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:05:11.676417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:11.676870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:11.677399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.677399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:11.720198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:11.721051 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:11.721891 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:11.722269 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:11.722403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.723228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:11.723228 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:11.723228 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:11.723228 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:11.723228 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:11.723228 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:11.723228 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.723228 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:11.725196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.725196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:11.725196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:11.725196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:11.725196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:11.725196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:11.725196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:11.725196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:11.725196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:11.725196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:11.725196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:11.725196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:11.725196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:11.725196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:05:11.725196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:11.725196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:11.725196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:11.725875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:15.797649 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:15.807193 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 07 20:05:15.807335 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=104575) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 07 20:05:15.807435 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Maintenance task: Fixing resource bfbf6c8f-1f7e-474c-a618-4e99355c0282 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:05:15.847342 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, resource={'id': 'bfbf6c8f-1f7e-474c-a618-4e99355c0282', 'name': 'private', 'tenant_id': '47ea4a7c5a154b528631c5537cfdb850', 'project_id': '47ea4a7c5a154b528631c5537cfdb850', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['49f10797-7993-4eac-ad9c-5db13bcf3a17', 'bdd6f685-b77d-459b-b386-e3ef09898997'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:35:01Z', 'updated_at': '2026-04-07T19:35:05Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39614}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:15.847543 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:15.847773 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-ca0b7fb0-3499-4804-b894-4bb867203f37, external_ids_update=None, columns={'tag': 39614}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:15.847855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:15.848539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:05:15.848539 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:15.848539 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:15.848539 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:15.848539 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:15.848539 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:15.848539 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:15.848539 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:15.849518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Maintenance task: Failed to fix resource bfbf6c8f-1f7e-474c-a618-4e99355c0282 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:15.849518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:05:15.849518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:05:15.849518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:05:15.849518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:05:15.849518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:05:15.849518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 20:05:15.849518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:15.849518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:15.849518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:05:15.849518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:15.850157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:15.850157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:15.850157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:05:15.850157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:15.850157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:05:15.850157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:15.850157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:05:15.850157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:05:15.850157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:15.850157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:05:15.850157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:15.850157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:05:15.850157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:05:15.850157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:15.850972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:05:15.850972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:15.850972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:05:15.850972 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Maintenance task: Fixing resource 92857a9a-261a-45c8-bdf2-793e5d5977e1 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:05:15.880174 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, resource={'id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'name': 'public', 'tenant_id': '47ea4a7c5a154b528631c5537cfdb850', 'project_id': '47ea4a7c5a154b528631c5537cfdb850', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['158905cc-b5be-42da-8777-3d7ded042b7c', '6de186a3-9e7c-4950-a1c6-817a37a68984'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-07T19:35:09Z', 'updated_at': '2026-04-07T19:35:17Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:15.880345 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:15.880738 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-783e27a6-53d0-42e0-a778-7125c7a0cff1, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:15.880997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:15.881711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:05:15.881711 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:15.881711 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:15.881711 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:15.881711 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:15.881711 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:15.881711 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:15.881711 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:15.882778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Maintenance task: Failed to fix resource 92857a9a-261a-45c8-bdf2-793e5d5977e1 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:15.882778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:05:15.882778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:05:15.882778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:05:15.882778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:05:15.882778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:05:15.882778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 20:05:15.882778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:15.882778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:15.882778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:05:15.882778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:15.883210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:15.883210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:15.883210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:05:15.883210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:15.883210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:05:15.883210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:15.883210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:05:15.883210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:05:15.883210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:15.883210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:05:15.883210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:15.883210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:05:15.883210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:05:15.883210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:15.883680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:05:15.883680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:15.883680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:05:15.883680 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Maintenance task: Fixing resource 246975ba-4717-4c89-a181-15f0da115b38 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:05:15.918243 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-246975ba-4717-4c89-a181-15f0da115b38, resource={'id': '246975ba-4717-4c89-a181-15f0da115b38', 'name': 'admin_net', 'tenant_id': 'c55e43aaf6164fb7ba8075ffd24bc8d2', 'project_id': 'c55e43aaf6164fb7ba8075ffd24bc8d2', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['4b75275b-2834-446a-a1bf-6e510e154273'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:40:24Z', 'updated_at': '2026-04-07T19:40:25Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 64449}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:15.918476 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-246975ba-4717-4c89-a181-15f0da115b38, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:15.918678 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-f0065b7a-ceb5-4313-9c13-1796e417df18, external_ids_update=None, columns={'tag': 64449}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:15.918770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:15.919275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:05:15.919275 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:15.919275 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:15.919275 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:15.919275 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:15.919275 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:15.919275 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:15.919275 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:15.920480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Maintenance task: Failed to fix resource 246975ba-4717-4c89-a181-15f0da115b38 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:15.920480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:05:15.920480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:05:15.920480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:05:15.920480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:05:15.920480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:05:15.920480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 20:05:15.920480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:15.920480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:15.920480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:05:15.920480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:15.921025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:15.921025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:15.921025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:05:15.921025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:15.921025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:05:15.921025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:15.921025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:05:15.921025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:05:15.921025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:15.921025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:05:15.921025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:15.921025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:05:15.921025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:05:15.921025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:15.921639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:05:15.921639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:15.921639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:05:15.921639 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Maintenance task: Fixing resource 40ad0605-2aac-4da1-b108-03821a0aa715 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:05:15.952019 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-40ad0605-2aac-4da1-b108-03821a0aa715, resource={'id': '40ad0605-2aac-4da1-b108-03821a0aa715', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'tenant_id': '7e48d42664ae4580840a2aef59d52e53', 'project_id': '7e48d42664ae4580840a2aef59d52e53', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['afc68917-6901-4e08-99ad-5c3d8bb8a584'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:41:05Z', 'updated_at': '2026-04-07T19:41:05Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 12961}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:15.952352 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-40ad0605-2aac-4da1-b108-03821a0aa715, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:15.952817 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-7853e8c0-165f-48a8-8e65-36b87d07f16a, external_ids_update=None, columns={'tag': 12961}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:15.953215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:15.954125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:05:15.954125 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:15.954125 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:15.954125 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:15.954125 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:15.954125 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:15.954125 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:15.954125 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:15.955625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Maintenance task: Failed to fix resource 40ad0605-2aac-4da1-b108-03821a0aa715 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:15.955625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:05:15.955625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:05:15.955625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:05:15.955625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:05:15.955625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:05:15.955625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 20:05:15.955625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:15.955625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:15.955625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:05:15.955625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:15.956155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:15.956155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:15.956155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:05:15.956155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:15.956155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:05:15.956155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:15.956155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:05:15.956155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:05:15.956155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:15.956155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:05:15.956155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:15.956155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:05:15.956155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:05:15.956155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:15.956917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:05:15.956917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:15.956917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:05:15.956917 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Maintenance task: Fixing resource 6e977c5e-85a0-4398-b359-5ba638de167e (type: routers) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:05:16.033849 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, resource={'id': '6e977c5e-85a0-4398-b359-5ba638de167e', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'project_id': '7e48d42664ae4580840a2aef59d52e53', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'external_fixed_ips': [{'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984', 'ip_address': '172.24.5.89'}, {'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c', 'ip_address': '2001:db8::d'}], 'enable_snat': True}, 'gw_port_id': '7f6e42e8-6279-4fd6-9649-d7b189f6dba8', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-a48jf', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'external_fixed_ips': [{'ip_address': '172.24.5.89', 'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984'}, {'ip_address': '2001:db8::d', 'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-07T19:41:06Z', 'updated_at': '2026-04-07T19:41:09Z', 'revision_number': 3, 'tenant_id': '7e48d42664ae4580840a2aef59d52e53'}, resource_type=routers, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:16.034235 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:16.034603 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "7f6e42e8-6279-4fd6-9649-d7b189f6dba8"')], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:16.034891 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "7f6e42e8-6279-4fd6-9649-d7b189f6dba8"')], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:16.035124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.036265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:05:16.036265 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:16.036265 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:16.036265 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:16.036265 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:16.036265 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:16.036265 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.036265 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:16.036704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Unable to update router 6e977c5e-85a0-4398-b359-5ba638de167e. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.038744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Maintenance task: Failed to fix resource 6e977c5e-85a0-4398-b359-5ba638de167e (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.038744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:05:16.038744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:05:16.038744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:05:16.038744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:05:16.038744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:05:16.038744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 07 20:05:16.038744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 07 20:05:16.038744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 07 20:05:16.038744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 07 20:05:16.038744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 07 20:05:16.039410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 07 20:05:16.039410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 07 20:05:16.039410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:16.039410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.039410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:05:16.039410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:16.039410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:16.039410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.039410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:05:16.039410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:16.039410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:05:16.039410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:16.039410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:05:16.039410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:05:16.040071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:16.040071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:05:16.040071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:16.040071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:05:16.040071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:05:16.040071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:16.040071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:05:16.040071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.040071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:05:16.040071 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Maintenance task: Fixing resource 7f6e42e8-6279-4fd6-9649-d7b189f6dba8 (type: router_ports) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:05:16.151545 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, resource={'id': '7f6e42e8-6279-4fd6-9649-d7b189f6dba8', 'name': '', 'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'project_id': '', 'mac_address': 'fa:16:3e:18:2e:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e977c5e-85a0-4398-b359-5ba638de167e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984', 'ip_address': '172.24.5.89'}, {'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c', 'ip_address': '2001:db8::d'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000164077', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-07T19:41:06Z', 'updated_at': '2026-04-07T19:41:09Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:16.151834 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '6de186a3-9e7c-4950-a1c6-817a37a68984 158905cc-b5be-42da-8777-3d7ded042b7c', 'neutron:network_name': 'neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-6e977c5e-85a0-4398-b359-5ba638de167e'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::d/64', '172.24.5.89/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:16.151943 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=7f6e42e8-6279-4fd6-9649-d7b189f6dba8, lrouter_port=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:16.152230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.152867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:05:16.152867 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:16.152867 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:16.152867 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:16.152867 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:16.152867 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:16.152867 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.152867 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:16.153931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Maintenance task: Failed to fix resource 7f6e42e8-6279-4fd6-9649-d7b189f6dba8 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.153931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:05:16.153931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:05:16.153931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:05:16.153931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:05:16.153931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:05:16.153931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 07 20:05:16.153931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:16.153931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.153931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:05:16.153931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:16.154582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:16.154582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.154582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:05:16.154582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:16.154582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:05:16.154582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:16.154582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:05:16.154582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:05:16.154582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:16.154582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:05:16.154582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:16.154582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:05:16.154582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:05:16.154582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:16.155448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:05:16.155448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.155448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:05:16.155448 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Maintenance task: Synchronization completed (took 0.35 seconds)
Apr 07 20:05:16.203223 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:16.204549 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:16.235808 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:16.236162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.236926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:05:16.236926 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:16.236926 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:16.236926 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:16.236926 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:16.236926 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:16.236926 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.236926 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:16.238310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.238310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:16.238310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:16.238310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:16.238310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:16.238310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:16.238310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:16.238310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:16.238310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:16.238310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:16.238310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:16.238310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:16.238310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:16.238310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:05:16.238310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:16.238310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.238310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.239246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:16.660350 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:16.661731 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:16.662085 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:16.662325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.663390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:05:16.663390 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:16.663390 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:16.663390 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:16.663390 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:16.663390 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:16.663390 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.663390 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:16.665914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.665914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:16.665914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:16.665914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:16.665914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:16.665914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:16.665914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:16.665914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:16.665914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:16.665914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:16.665914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:16.665914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:16.665914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:16.665914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:05:16.665914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:16.665914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.666815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:16.667785 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:16.667785 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:05:16.667785 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:16.667785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.668408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:16.668408 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:16.668408 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:16.668408 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:16.668408 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:16.668408 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:16.668408 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.668408 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:16.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:16.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:16.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:16.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:16.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:16.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:16.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:16.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:16.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:16.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:16.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:16.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:16.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:16.670459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:16.670459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:16.670459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:16.670459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:16.670459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:16.670459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:16.670459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.670459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:16.671189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.671189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:16.671189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:16.671189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:16.671189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:16.671189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:16.671189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:16.671189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:16.671189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:16.671189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:16.671189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:16.671189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:16.671189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:16.671189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:05:16.671189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:05:16.671189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:16.671720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:16.672210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:16.672210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.672210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:16.672210 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:16.672394 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:16.672787 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:16.673057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.673547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:16.673547 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:16.673547 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:16.673547 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:16.673547 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:16.673547 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:16.673547 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.673547 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:16.674406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.674406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:16.674406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:16.674406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:16.674406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.674406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:16.674406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:16.674406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:16.674406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.674406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:16.674406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:16.674406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:16.674406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:16.674406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:16.674406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:16.674406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:16.674809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:16.674809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:16.674809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:16.674809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:16.674809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:16.674809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:16.674809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.674809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:16.675409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.675409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:16.675409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:16.675409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:16.675409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:16.675409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:16.675409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:16.675409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:16.675409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:16.675409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:16.675409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:16.675409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:16.675409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:16.675409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:05:16.675409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:05:16.675409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:16.675894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:16.676389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.676389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:16.720680 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:16.720852 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:16.721200 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:16.721451 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:16.721599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.722085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:16.722085 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:16.722085 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:16.722085 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:16.722085 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:16.722085 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:16.722085 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.722085 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:16.722801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.722801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:16.722801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:16.722801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:16.722801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:16.722801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:16.722801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:16.722801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:16.722801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:16.722801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:16.722801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:16.722801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:16.722801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:16.722801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:05:16.722801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:16.722801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.722801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:16.723693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:21.204094 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:21.206338 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:21.208961 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=434 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:05:21.244196 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:21.244196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.245104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:05:21.245104 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:21.245104 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:21.245104 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:21.245104 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:21.245104 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:21.245104 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.245104 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:21.246385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.246385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:21.246385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:21.246385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:21.246385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:21.246385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:21.246385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:21.246385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:21.246385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:21.246385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:21.246385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:21.246385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:21.246385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:21.246385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:05:21.246385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:21.246385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:21.246385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.247035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:21.661187 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:21.662325 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:21.662464 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:21.662665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.663522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:05:21.663522 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:21.663522 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:21.663522 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:21.663522 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:21.663522 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:21.663522 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.663522 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:21.664714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.664714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:21.664714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:21.664714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:21.664714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:21.664714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:21.664714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:21.664714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:21.664714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:21.664714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:21.664714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:21.664714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:21.664714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:21.664714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:05:21.664714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:21.664714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.665858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:21.666594 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:21.667072 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:05:21.667576 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:21.667781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.668425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:21.668425 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:21.668425 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:21.668425 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:21.668425 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:21.668425 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:21.668425 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.668425 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:21.670070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.670070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:21.670070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:21.670070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:21.670070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:21.670070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:21.670070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:21.670070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:21.670070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:21.670070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:21.670070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:21.670070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:21.670070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:21.670070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:21.670070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:21.670070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:21.670712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:21.670712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:21.670712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:21.670712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:21.670712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:21.670712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:21.670712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.670712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:21.671139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.671139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:21.671139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:21.671139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:21.671139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:21.671139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:21.671139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:21.671139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:21.671139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:21.671139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:21.671139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:21.671139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:21.671139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:21.671139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:05:21.671139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:05:21.671139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:21.671767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:21.672511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:21.672511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.672511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:21.672511 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:21.673146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:21.673693 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:21.673954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.674610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:21.674610 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:21.674610 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:21.674610 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:21.674610 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:21.674610 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:21.674610 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.674610 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:21.676365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.676365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:21.676365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:21.676365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:21.676365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:21.676365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:21.676365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:21.676365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:21.676365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:21.676365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:21.676365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:21.676365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:21.676365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:21.676365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:21.676365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:21.676365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:21.676892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:21.676892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:21.676892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:21.676892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:21.676892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:21.676892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:21.676892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.676892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:21.678408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.678408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:21.678408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:21.678408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:21.678408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:21.678408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:21.678408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:21.678408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:21.678408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:21.678408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:21.678408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:21.678408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:21.678408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:21.678408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:05:21.678408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:05:21.678408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:21.679243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:21.680301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.680301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:21.721596 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:21.722134 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:21.722653 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:21.722957 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:21.723155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.723900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:21.723900 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:21.723900 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:21.723900 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:21.723900 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:21.723900 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:21.723900 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.723900 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:21.727487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.727487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:21.727487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:21.727487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:21.727487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:21.727487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:21.727487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:21.727487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:21.727487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:21.727487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:21.727487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:21.727487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:21.727487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:21.727487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:05:21.727487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:21.727487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:21.727487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:21.728871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:26.204958 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:26.207017 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:26.239521 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:26.239911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.240819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:05:26.240819 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:26.240819 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:26.240819 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:26.240819 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:26.240819 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:26.240819 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.240819 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:26.241778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.241778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:26.241778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:26.241778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:26.241778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:26.241778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:26.241778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:26.241778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:26.241778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:26.241778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:26.241778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:26.241778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:26.241778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:26.241778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:05:26.241778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:26.241778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:26.241778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.242691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:26.661957 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:26.663129 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:26.663460 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:26.663704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.664740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:05:26.664740 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:26.664740 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:26.664740 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:26.664740 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:26.664740 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:26.664740 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.664740 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:26.666943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.666943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:26.666943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:26.666943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:26.666943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:26.666943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:26.666943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:26.666943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:26.666943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:26.666943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:26.666943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:26.666943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:26.666943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:26.666943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:05:26.666943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:26.666943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.668245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:26.669403 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:26.669403 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:05:26.669403 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:26.669403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:26.669701 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:26.669701 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:26.669701 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:26.669701 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:26.669701 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:26.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.669701 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:26.671244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.671244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:26.671244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:26.671244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:26.671244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:26.671244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:26.671244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:26.671244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:26.671244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:26.671244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:26.671244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:26.671244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:26.671244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:26.671244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:26.671244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:26.671244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:26.672049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:26.672049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:26.672049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:26.672049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:26.672049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:26.672049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:26.672049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.672049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:26.673287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.673287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:26.673287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:26.673287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:26.673287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:26.673287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:26.673287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:26.673287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:26.673287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:26.673287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:26.673287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:26.673287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:26.673287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:26.673287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:05:26.673287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:05:26.673287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:26.673883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:26.674596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:26.674596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.674596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:26.674596 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:26.674596 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:26.674596 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:26.674823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.675223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:26.675223 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:26.675223 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:26.675223 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:26.675223 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:26.675223 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:26.675223 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.675223 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:26.676555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.676555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:26.676555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:26.676555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:26.676555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:26.676555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:26.676555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:26.676555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:26.676555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:26.676555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:26.676555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:26.676555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:26.676555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:26.676555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:26.676555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:26.676555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:26.677037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:26.677037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:26.677037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:26.677037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:26.677037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:26.677037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:26.677037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.677037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:26.678242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.678242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:26.678242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:26.678242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:26.678242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:26.678242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:26.678242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:26.678242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:26.678242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:26.678242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:26.678242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:26.678242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:26.678242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:26.678242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:05:26.678242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:05:26.678242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:26.678734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:26.679260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.679260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:26.722032 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:26.722603 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:26.723211 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:26.723585 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:26.723843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.724676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:26.724676 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:26.724676 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:26.724676 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:26.724676 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:26.724676 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:26.724676 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.724676 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:26.726766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.726766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:26.726766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:26.726766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:26.726766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:26.726766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:26.726766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:26.726766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:26.726766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:26.726766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:26.726766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:26.726766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:26.726766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:26.726766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:05:26.726766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:26.726766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:26.726766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:26.727651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:31.205720 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:31.206896 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:31.234835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:31.234835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.235356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:05:31.235356 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:31.235356 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:31.235356 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:31.235356 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:31.235356 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:31.235356 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.235356 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:31.236454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.236454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:31.236454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:31.236454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:31.236454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:31.236454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:31.236454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:31.236454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:31.236454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:31.236454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:31.236454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:31.236454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:31.236454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:31.236454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:05:31.236454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:31.236454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:31.236454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.237497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:31.662511 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:31.663859 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:31.664193 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:31.664428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.665362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:05:31.665362 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:31.665362 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:31.665362 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:31.665362 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:31.665362 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:31.665362 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.665362 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:31.667104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.667104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:31.667104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:31.667104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:31.667104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:31.667104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:31.667104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:31.667104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:31.667104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:31.667104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:31.667104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:31.667104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:31.667104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:31.667104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:05:31.667104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:31.667104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.668641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:31.669882 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:31.669882 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:05:31.669882 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:31.669882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.670585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:31.670585 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:31.670585 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:31.670585 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:31.670585 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:31.670585 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:31.670585 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.670585 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:31.671643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.671643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:31.671643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:31.671643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:31.671643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:31.671643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:31.671643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:31.671643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:31.671643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:31.671643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:31.671643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:31.671643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:31.671643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:31.671643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:31.671643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:31.671643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:31.672863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:31.672863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:31.672863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:31.672863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:31.672863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:31.672863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:31.672863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.672863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:31.673521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.673521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:31.673521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:31.673521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:31.673521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:31.673521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:31.673521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:31.673521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:31.673521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:31.673521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:31.673521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:31.673521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:31.673521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:31.673521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:05:31.673521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:05:31.673521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:31.673949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:31.674313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:31.674313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.674313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:31.674313 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:31.674733 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:31.675186 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:31.675548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.676229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:31.676229 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:31.676229 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:31.676229 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:31.676229 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:31.676229 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:31.676229 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.676229 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:31.677133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.677133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:31.677133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:31.677133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:31.677133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:31.677133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:31.677133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:31.677133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:31.677133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:31.677133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:31.677133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:31.677133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:31.677133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:31.677133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:31.677133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:31.677133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:31.677476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:31.677476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:31.677476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:31.677476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:31.677476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:31.677476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:31.677476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.677476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:31.678196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.678196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:31.678196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:31.678196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:31.678196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:31.678196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:31.678196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:31.678196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:31.678196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:31.678196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:31.678196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:31.678196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:31.678196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:31.678196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:05:31.678196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:05:31.678196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:31.678637 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:31.679134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.679134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:31.722687 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:31.723394 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:31.724019 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:31.724436 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:31.724624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.725398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:31.725398 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:31.725398 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:31.725398 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:31.725398 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:31.725398 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:31.725398 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.725398 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:31.727210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.727210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:31.727210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:31.727210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:31.727210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:31.727210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:31.727210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:31.727210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:31.727210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:31.727210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:31.727210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:31.727210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:31.727210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:31.727210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:05:31.727210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:31.727210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:31.727210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:31.728124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:36.206325 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:36.208188 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:36.242428 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:36.242840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.243748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:05:36.243748 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:36.243748 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:36.243748 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:36.243748 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:36.243748 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:36.243748 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.243748 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:36.244898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.244898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:36.244898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:36.244898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:36.244898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:36.244898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:36.244898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:36.244898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:36.244898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:36.244898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:36.244898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:36.244898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:36.244898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:36.244898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:05:36.244898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:36.244898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:36.244898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.245516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:36.663269 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:36.664339 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:36.664608 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:36.664774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.665594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:05:36.665594 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:36.665594 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:36.665594 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:36.665594 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:36.665594 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:36.665594 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.665594 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:36.666808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.666808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:36.666808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:36.666808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:36.666808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:36.666808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:36.666808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:36.666808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:36.666808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:36.666808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:36.666808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:36.666808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:36.666808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:36.666808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:05:36.666808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:36.666808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.667778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:36.668653 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:36.668768 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:05:36.669242 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:36.669461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.670026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:36.670026 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:36.670026 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:36.670026 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:36.670026 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:36.670026 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:36.670026 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.670026 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:36.671412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.671412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:36.671412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:36.671412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:36.671412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:36.671412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:36.671412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:36.671412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:36.671412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:36.671412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:36.671412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:36.671412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:36.671412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:36.671412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:36.671412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:36.671412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:36.672480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:36.672480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:36.672480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:36.672480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:36.672480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:36.672480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:36.672480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.672480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:36.673180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.673180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:36.673180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:36.673180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:36.673180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:36.673180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:36.673180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:36.673180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:36.673180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:36.673180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:36.673180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:36.673180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:36.673180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:36.673180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:05:36.673180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:05:36.673180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:36.674497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:36.675439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:36.675439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.675439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:36.675439 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:36.675439 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:36.675714 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:36.675783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.676301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:36.676301 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:36.676301 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:36.676301 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:36.676301 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:36.676301 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:36.676301 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.676301 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:36.678172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.678172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:36.678172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:36.678172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:36.678172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:36.678172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:36.678172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:36.678172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:36.678172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:36.678172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:36.678172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:36.678172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:36.678172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:36.678172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:36.678172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:36.678172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:36.678668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:36.678668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:36.678668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:36.678668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:36.678668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:36.678668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:36.678668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.678668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:36.679951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.679951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:36.679951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:36.679951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:36.679951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:36.679951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:36.679951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:36.679951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:36.679951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:36.679951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:36.679951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:36.679951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:36.679951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:36.679951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:05:36.679951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:05:36.679951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:36.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:36.681158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.681158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:36.723291 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:36.724185 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:36.725129 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:36.725729 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:36.726182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.727031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:36.727031 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:36.727031 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:36.727031 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:36.727031 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:36.727031 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:36.727031 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.727031 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:36.728771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.728771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:36.728771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:36.728771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:36.728771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:36.728771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:36.728771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:36.728771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:36.728771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:36.728771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:36.728771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:36.728771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:36.728771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:36.728771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:05:36.728771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:36.728771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:36.728771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:36.729588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:41.207032 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:41.208981 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:41.248851 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:41.249266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.250492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:05:41.250492 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:41.250492 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:41.250492 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:41.250492 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:41.250492 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:41.250492 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.250492 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:41.251553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.251553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:41.251553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:41.251553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:41.251553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:41.251553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:41.251553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:41.251553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:41.251553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:41.251553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:41.251553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:41.251553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:41.251553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:41.251553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:05:41.251553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:41.251553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:41.251553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.252452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:41.664027 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:41.665180 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:41.665805 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:41.665805 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.666400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:05:41.666400 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:41.666400 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:41.666400 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:41.666400 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:41.666400 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:41.666400 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.666400 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:41.667514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.667514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:41.667514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:41.667514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:41.667514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:41.667514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:41.667514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:41.667514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:41.667514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:41.667514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:41.667514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:41.667514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:41.667514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:41.667514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:05:41.667514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:41.667514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.668598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:41.670297 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:41.670297 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:05:41.670297 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:41.670297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.670735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:41.670735 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:41.670735 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:41.670735 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:41.670735 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:41.670735 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:41.670735 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.670735 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:41.671657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.671657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:41.671657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:41.671657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:41.671657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:41.671657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:41.671657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:41.671657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:41.671657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:41.671657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:41.671657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:41.671657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:41.671657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:41.671657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:41.671657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:41.671657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:41.672961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:41.672961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:41.672961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:41.672961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:41.672961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:41.672961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:41.672961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.672961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:41.673338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.673338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:41.673338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:41.673338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:41.673338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:41.673338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:41.673338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:41.673338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:41.673338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:41.673338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:41.673338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:41.673338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:41.673338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:41.673338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:05:41.673338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:05:41.673338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:41.674004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:41.674777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:41.674777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.674777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:41.675160 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:41.675474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:41.675951 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:41.676260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.676806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:41.676806 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:41.676806 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:41.676806 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:41.676806 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:41.676806 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:41.676806 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.676806 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:41.677659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.677659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:41.677659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:41.677659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:41.677659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:41.677659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:41.677659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:41.677659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:41.677659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:41.677659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:41.677659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:41.677659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:41.677659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:41.677659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:41.677659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:41.677659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:41.678334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:41.678334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:41.678334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:41.678334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:41.678334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:41.678334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:41.678334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.678334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:41.678881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.678881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:41.678881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:41.678881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:41.678881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:41.678881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:41.678881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:41.678881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:41.678881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:41.678881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:41.678881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:41.678881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:41.678881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:41.678881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:05:41.678881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:05:41.678881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:41.679584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:41.680392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.680392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:41.723894 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:41.724203 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:41.724932 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:41.725627 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:41.725961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.726746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:41.726746 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:41.726746 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:41.726746 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:41.726746 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:41.726746 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:41.726746 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.726746 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:41.728640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.728640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:41.728640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:41.728640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:41.728640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:41.728640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:41.728640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:41.728640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:41.728640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:41.728640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:41.728640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:41.728640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:41.728640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:41.728640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:05:41.728640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:41.728640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:41.728640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:41.729168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:46.207875 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:46.209664 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:46.249927 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:46.251278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.251616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:05:46.251616 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:46.251616 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:46.251616 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:46.251616 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:46.251616 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:46.251616 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.251616 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:46.252834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.252834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:46.252834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:46.252834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:46.252834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:46.252834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:46.252834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:46.252834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:46.252834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:46.252834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:46.252834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:46.252834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:46.252834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:46.252834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:05:46.252834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:46.252834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:46.252834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.254045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:46.664770 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:46.665731 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:46.666014 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:46.666174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.667099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:05:46.667099 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:46.667099 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:46.667099 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:46.667099 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:46.667099 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:46.667099 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.667099 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:46.669542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.669542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:46.669542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:46.669542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:46.669542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:46.669542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:46.669542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:46.669542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:46.669542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:46.669542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:46.669542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:46.669542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:46.669542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:46.669542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:05:46.669542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:46.669542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.670277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:46.671146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:46.671146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:05:46.671146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:46.671312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.672206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:05:46.672206 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:46.672206 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:46.672206 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:46.672206 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:46.672206 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:46.672206 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.672206 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:46.672960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.672960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:46.672960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:46.672960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:46.672960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:46.672960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:46.672960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:46.672960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:46.672960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:46.672960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:46.672960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:46.672960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:46.672960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:46.672960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:46.672960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:46.673639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:46.673639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:46.673639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:46.673639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:46.673639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:46.673639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:46.673639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:46.673639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.673639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:46.674044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.674044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:46.674044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:46.674044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:46.674044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:46.674044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:46.674044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:46.674044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:46.674044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:46.674044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:46.674044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:46.674044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:46.674044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:46.674044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:05:46.674044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:05:46.674044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:46.674694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:46.675460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:46.675460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.675460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:46.675588 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:46.675975 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:46.676534 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:46.677011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.677837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:46.677837 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:46.677837 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:46.677837 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:46.677837 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:46.677837 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:46.677837 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.677837 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:46.678810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.678810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:46.678810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:46.678810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:46.678810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:46.678810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:46.678810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:46.678810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:46.678810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:46.678810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:46.678810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:46.678810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:46.678810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:46.678810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:46.678810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:46.678810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:46.679713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:46.679713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:46.679713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:46.679713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:46.679713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:46.679713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:46.679713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.679713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:46.680093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.680093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:46.680093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:46.680093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:46.680093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:46.680093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:46.680093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:46.680093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:46.680093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:46.680093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:46.680093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:46.680093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:46.680093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:46.680093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:05:46.680093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:05:46.680093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:46.680569 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:46.681079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.681079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:46.724708 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:46.725318 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:46.726187 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:46.726865 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:46.727253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.728284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:46.728284 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:46.728284 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:46.728284 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:46.728284 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:46.728284 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:46.728284 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.728284 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:46.730288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.730288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:46.730288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:46.730288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:46.730288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:46.730288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:46.730288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:46.730288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:46.730288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:46.730288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:46.730288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:46.730288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:46.730288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:46.730288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:05:46.730288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:46.730288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:46.730288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:46.731536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:51.211839 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:51.213966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:51.255029 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:51.255410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.256592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:05:51.256592 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:51.256592 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:51.256592 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:51.256592 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:51.256592 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:51.256592 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.256592 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:51.257456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.257456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:51.257456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:51.257456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:51.257456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:51.257456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:51.257456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:51.257456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:51.257456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:51.257456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:51.257456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:51.257456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:51.257456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:51.257456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:05:51.257456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:51.257456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:51.257456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.258801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:51.665581 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:51.667247 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:51.667537 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:51.667712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.668817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:05:51.668817 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:51.668817 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:51.668817 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:51.668817 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:51.668817 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:51.668817 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.668817 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:51.670573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.670573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:51.670573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:51.670573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:51.670573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:51.670573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:51.670573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:51.670573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:51.670573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:51.670573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:51.670573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:51.670573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:51.670573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:51.670573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:05:51.670573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:51.670573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.671414 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:51.672299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:51.672299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:05:51.672744 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:51.673001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.673694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:51.673694 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:51.673694 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:51.673694 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:51.673694 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:51.673694 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:51.673694 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.673694 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:51.675115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.675115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:51.675115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:51.675115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:51.675115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:51.675115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:51.675115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:51.675115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:51.675115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:51.675115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:51.675115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:51.675115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:51.675115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:51.675115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:51.675115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:51.675115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:51.676186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:51.676186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:51.676186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:51.676186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:51.676186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:51.676186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:51.676186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.676186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:51.676734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.676734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:51.676734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:51.676734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:51.676734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:51.676734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:51.676734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:51.676734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:51.676734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:51.676734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:51.676734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:51.676734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:51.676734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:51.676734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:05:51.676734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:05:51.676734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:51.677686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:51.678434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:51.678434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.678434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:51.678434 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:51.678434 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:51.678434 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:51.678434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.679260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:51.679260 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:51.679260 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:51.679260 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:51.679260 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:51.679260 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:51.679260 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.679260 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:51.680035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.680035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:51.680035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:51.680035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:51.680035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:51.680035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:51.680035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:51.680035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:51.680035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:51.680035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:51.680035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:51.680035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:51.680035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:51.680035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:51.680035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:51.680035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:51.680581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:51.680581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:51.680581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:51.680581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:51.680581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:51.680581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:51.680581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.680581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:51.680813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.680813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:51.680813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:51.680813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:51.680813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:51.680813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:51.680813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:51.680813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:51.680813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:51.680813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:51.680813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:51.680813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:51.680813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:51.680813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:05:51.680813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:05:51.680813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:51.681355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:51.681844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.681844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:51.725566 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:51.726755 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4a2f381f-a890-499f-91c0-92d444eced6e None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:51.727852 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:51.728548 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:51.728915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.729884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4a2f381f-a890-499f-91c0-92d444eced6e None None] Traceback (most recent call last):
Apr 07 20:05:51.729884 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:51.729884 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:51.729884 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:51.729884 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:51.729884 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:51.729884 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.729884 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:51.731449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-4a2f381f-a890-499f-91c0-92d444eced6e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.731449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:51.731449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:51.731449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:51.731449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:51.731449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:51.731449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:51.731449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:51.731449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:51.731449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:51.731449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:51.731449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:51.731449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:51.731449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:05:51.731449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:51.731449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:51.731449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:51.732276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:56.212443 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:56.214460 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:56.254129 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:56.254664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.255869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:05:56.255869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:56.255869 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:56.255869 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:56.255869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:56.255869 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:56.255869 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.255869 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:56.257129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.257129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:56.257129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:56.257129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:56.257129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:56.257129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:56.257129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:56.257129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:56.257129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:56.257129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:56.257129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:56.257129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:56.257129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:56.257129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:05:56.257129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:56.257129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:56.257129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.258088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:56.666409 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:56.668066 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:56.668473 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:56.668738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.670139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:05:56.670139 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:56.670139 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:56.670139 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:56.670139 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:56.670139 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:56.670139 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.670139 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:56.672936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.672936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:56.672936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:56.672936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:56.672936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:56.672936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:56.672936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:56.672936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:56.672936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:56.672936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:56.672936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:56.672936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:56.672936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:56.672936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:05:56.672936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:56.672936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.673853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:56.674868 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:56.674868 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:05:56.674868 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:56.675145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.676004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:56.676004 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:56.676004 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:56.676004 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:56.676004 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:56.676004 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:56.676004 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.676004 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:56.677576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.677576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:56.677576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:56.677576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:56.677576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:56.677576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:56.677576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:56.677576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:56.677576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:56.677576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:56.677576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:56.677576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:56.677576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:56.677576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:56.677576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:56.677576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:56.678141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:56.678141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:56.678141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:56.678141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:56.678141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:56.678141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:56.678141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.678141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:56.678141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:56.680461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.680461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:56.680461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:56.680461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:56.680461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:56.680461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:56.680461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:56.680461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:56.680461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:56.680461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:56.680461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:56.680461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:56.680461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:56.680461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:05:56.680461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:05:56.680461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:56.680997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:56.681529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:56.681529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.681529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:56.681529 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:56.681529 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:56.681529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.681801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:05:56.681801 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:56.681801 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:56.681801 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:56.681801 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:56.681801 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:56.681801 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.681801 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:56.682499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.682499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:05:56.682499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:56.682499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:56.682499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:56.682499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:56.682499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:56.682499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:56.682499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:56.682499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:05:56.682499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:56.682499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:05:56.682499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:56.682499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:05:56.682499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:05:56.682499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:56.682919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:05:56.682919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:56.682919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:05:56.682919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:05:56.682919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:56.682919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:05:56.682919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.682919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:05:56.683508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.683508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:56.683508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:56.683508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:56.683508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:56.683508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:56.683508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:56.683508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:56.683508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:56.683508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:56.683508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:56.683508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:56.683508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:56.683508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:05:56.683508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:05:56.683508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:56.684004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:56.684550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.684550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:05:56.726523 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:05:56.727128 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:05:56.727800 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:56.728404 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:05:56.728786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.730133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Traceback (most recent call last):
Apr 07 20:05:56.730133 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:56.730133 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:05:56.730133 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:05:56.730133 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:56.730133 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:05:56.730133 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.730133 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:05:56.732339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-d0ddcd5e-e1e4-4229-9b02-6f8441ee44f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.732339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:05:56.732339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:05:56.732339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:05:56.732339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:05:56.732339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:05:56.732339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:56.732339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:05:56.732339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:05:56.732339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:05:56.732339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:05:56.732339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:05:56.732339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:05:56.732339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:05:56.732339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:05:56.732339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:56.732339 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:05:56.733236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:01.213161 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:01.214899 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:01.249586 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:01.249921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.251171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:06:01.251171 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:01.251171 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:01.251171 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:01.251171 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:01.251171 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:01.251171 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.251171 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:01.252275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.252275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:01.252275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:01.252275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:01.252275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:01.252275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:01.252275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:01.252275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:01.252275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:01.252275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:01.252275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:01.252275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:01.252275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:01.252275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:06:01.252275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:01.252275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:01.252275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.253044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:01.667288 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:01.668822 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:01.669211 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:01.669455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.670492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:06:01.670492 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:01.670492 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:01.670492 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:01.670492 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:01.670492 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:01.670492 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.670492 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:01.671712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.671712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:01.671712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:01.671712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:01.671712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:01.671712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:01.671712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:01.671712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:01.671712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:01.671712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:01.671712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:01.671712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:01.671712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:01.671712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:06:01.671712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:01.671712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.672506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:01.673839 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:01.674146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:06:01.674640 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:01.674935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.676545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:01.676545 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:01.676545 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:01.676545 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:01.676545 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:01.676545 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:01.676545 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.676545 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:01.677905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.677905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:01.677905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:01.677905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:01.677905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:01.677905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:01.677905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:01.677905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:01.677905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:01.677905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:01.677905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:01.677905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:01.677905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:01.677905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:01.677905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:01.677905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:01.678918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:01.678918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:01.678918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:01.678918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:01.678918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:01.678918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:01.678918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.678918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:01.679387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.679387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:01.679387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:01.679387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:01.679387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:01.679387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:01.679387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:01.679387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:01.679387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:01.679387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:01.679387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:01.679387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:01.679387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:01.679387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:06:01.679387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:06:01.679387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:01.680296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:01.681548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:01.681548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.681548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:01.681548 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:01.681548 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:01.681548 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:01.681548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.681548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:01.681548 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:01.681548 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:01.681548 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:01.681548 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:01.681548 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:01.682177 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.682177 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:01.682177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.682177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:01.682177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:01.682177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:01.682177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:01.682177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:01.682177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:01.682177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:01.682177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:01.682177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:01.682177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:01.682177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:01.682177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:01.682177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:01.682177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:01.683054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:01.683054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:01.683054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:01.683054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:01.683054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:01.683054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:01.683054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:01.683054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.683054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:01.683380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.683380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:01.683380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:01.683380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:01.683380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:01.683380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:01.683380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:01.683380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:01.683380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:01.683380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:01.683380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:01.683380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:01.683380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:01.683380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:06:01.683380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:06:01.683380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:01.683874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:01.684425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.684425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:01.727229 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:01.727777 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:01.728597 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:01.729018 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:01.729313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.730374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Traceback (most recent call last):
Apr 07 20:06:01.730374 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:01.730374 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:01.730374 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:01.730374 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:01.730374 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:01.730374 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.730374 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:01.733023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-1f9f4793-64a1-4248-8121-272a5c5b853d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.733023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:01.733023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:01.733023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:01.733023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:01.733023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:01.733023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:01.733023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:01.733023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:01.733023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:01.733023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:01.733023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:01.733023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:01.733023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:06:01.733023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:01.733023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:01.733023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:01.734137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:06.213940 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:06.215774 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:06.252543 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:06.253038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.253958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:06:06.253958 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:06.253958 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:06.253958 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:06.253958 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:06.253958 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:06.253958 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.253958 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:06.255336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.255336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:06.255336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:06.255336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:06.255336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:06.255336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:06.255336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:06.255336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:06.255336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:06.255336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:06.255336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:06.255336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:06.255336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:06.255336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:06:06.255336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:06.255336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:06.255336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.256501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:06.668391 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:06.669789 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:06.670155 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:06.670400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.671495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:06:06.671495 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:06.671495 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:06.671495 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:06.671495 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:06.671495 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:06.671495 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.671495 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:06.673086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.673086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:06.673086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:06.673086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:06.673086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:06.673086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:06.673086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:06.673086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:06.673086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:06.673086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:06.673086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:06.673086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:06.673086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:06.673086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:06:06.673086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:06.673086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.673913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:06.675035 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:06.675035 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:06:06.675035 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:06.675379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.676128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:06:06.676128 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:06.676128 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:06.676128 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:06.676128 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:06.676128 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:06.676128 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.676128 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:06.676704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.676704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:06.676704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:06.676704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:06.676704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:06.676704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:06.676704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:06.676704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:06.676704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:06.676704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:06.676704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:06.676704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:06.676704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:06.676704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:06.676704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:06.677221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:06.677221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:06.677221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:06.677221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:06.677221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:06.677221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:06.677221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:06.677221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.677221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:06.677525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.677525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:06.677525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:06.677525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:06.677525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:06.677525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:06.677525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:06.677525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:06.677525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:06.677525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:06.677525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:06.677525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:06.677525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:06.677525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:06:06.677525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:06:06.677525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:06.677955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:06.678459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:06.678459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.678459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:06.679815 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:06.680356 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:06.680896 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:06.681374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.682221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:06.682221 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:06.682221 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:06.682221 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:06.682221 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:06.682221 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:06.682221 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.682221 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:06.683033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.683033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:06.683033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:06.683033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:06.683033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:06.683033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:06.683033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:06.683033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:06.683033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:06.683033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:06.683033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:06.683033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:06.683033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:06.683033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:06.683033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:06.683033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:06.683603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:06.683603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:06.683603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:06.683603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:06.683603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:06.683603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:06.683603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.683603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:06.684279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.684279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:06.684279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:06.684279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:06.684279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:06.684279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:06.684279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:06.684279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:06.684279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:06.684279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:06.684279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:06.684279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:06.684279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:06.684279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:06:06.684279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:06:06.684279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:06.684768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:06.685335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.685335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:06.727914 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:06.728386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:06.729248 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:06.730114 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:06.730432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.731317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:06.731317 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:06.731317 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:06.731317 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:06.731317 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:06.731317 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:06.731317 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.731317 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:06.733496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.733496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:06.733496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:06.733496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:06.733496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:06.733496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:06.733496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:06.733496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:06.733496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:06.733496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:06.733496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:06.733496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:06.733496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:06.733496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:06:06.733496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:06.733496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:06.733496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:06.734971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:11.214497 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:11.216157 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:11.249592 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:11.249974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.251000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:06:11.251000 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:11.251000 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:11.251000 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:11.251000 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:11.251000 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:11.251000 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.251000 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:11.252280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.252280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:11.252280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:11.252280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:11.252280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:11.252280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:11.252280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:11.252280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:11.252280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:11.252280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:11.252280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:11.252280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:11.252280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:11.252280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:06:11.252280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:11.252280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:11.252280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.252828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:11.668862 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:11.670123 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:11.670333 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:11.670443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.671245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:06:11.671245 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:11.671245 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:11.671245 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:11.671245 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:11.671245 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:11.671245 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.671245 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:11.673203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.673203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:11.673203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:11.673203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:11.673203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:11.673203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:11.673203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:11.673203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:11.673203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:11.673203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:11.673203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:11.673203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:11.673203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:11.673203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:06:11.673203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:11.673203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.674048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:11.674926 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:11.675438 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:06:11.675788 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:11.675946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.676539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:06:11.676539 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:11.676539 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:11.676539 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:11.676539 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:11.676539 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:11.676539 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.676539 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:11.677925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.677925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:11.677925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:11.677925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:11.677925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:11.677925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:11.677925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:11.677925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:11.677925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:11.677925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:11.677925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:11.677925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:11.677925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:11.677925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:11.677925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:11.678726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:11.678726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:11.678726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:11.678726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:11.678726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:11.678726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:11.678726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:11.678726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.678726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:11.679551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.679551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:11.679551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:11.679551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:11.679551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:11.679551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:11.679551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:11.679551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:11.679551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:11.679551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:11.679551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:11.679551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:11.679551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:11.679551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:06:11.679551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:06:11.679551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:11.680470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:11.681196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:11.681196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.681196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:11.681196 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:11.681196 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:11.681658 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:11.682178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.682912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:11.682912 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:11.682912 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:11.682912 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:11.682912 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:11.682912 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:11.682912 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.682912 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:11.684186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.684186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:11.684186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:11.684186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:11.684186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:11.684186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:11.684186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:11.684186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:11.684186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:11.684186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:11.684186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:11.684186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:11.684186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:11.684186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:11.684186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:11.684186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:11.684631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:11.684631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:11.684631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:11.684631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:11.684631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:11.684631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:11.684631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.684631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:11.685839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.685839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:11.685839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:11.685839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:11.685839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:11.685839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:11.685839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:11.685839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:11.685839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:11.685839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:11.685839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:11.685839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:11.685839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:11.685839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:06:11.685839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:06:11.685839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:11.686327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:11.686779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.686779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:11.728532 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:11.729077 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:11.729635 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:11.730141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:11.730609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.731389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:11.731389 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:11.731389 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:11.731389 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:11.731389 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:11.731389 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:11.731389 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.731389 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:11.732771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.732771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:11.732771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:11.732771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:11.732771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:11.732771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:11.732771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:11.732771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:11.732771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:11.732771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:11.732771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:11.732771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:11.732771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:11.732771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:06:11.732771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:11.732771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:11.732771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:11.733415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:16.215565 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:16.216704 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:16.251818 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:16.252306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.253203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:06:16.253203 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:16.253203 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:16.253203 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:16.253203 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:16.253203 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:16.253203 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.253203 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:16.254089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.254089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:16.254089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:16.254089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:16.254089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:16.254089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:16.254089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:16.254089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:16.254089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:16.254089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:16.254089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:16.254089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:16.254089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:16.254089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:06:16.254089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:16.254089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:16.254089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.254646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:16.669759 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:16.671023 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:16.671395 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:16.671642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.672575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:06:16.672575 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:16.672575 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:16.672575 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:16.672575 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:16.672575 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:16.672575 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.672575 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:16.673789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.673789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:16.673789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:16.673789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:16.673789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:16.673789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:16.673789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:16.673789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:16.673789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:16.673789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:16.673789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:16.673789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:16.673789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:16.673789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:06:16.673789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:16.673789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.674618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:16.675578 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:16.675948 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:06:16.676609 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:16.676869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.677633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:06:16.677633 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:16.677633 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:16.677633 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:16.677633 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:16.677633 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:16.677633 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.677633 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:16.678943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.678943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:16.678943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:16.678943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:16.678943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:16.678943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:16.678943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:16.678943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:16.678943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:16.678943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:16.678943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:16.678943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:16.678943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:16.678943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:16.678943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:16.679454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:16.679454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:16.679454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:16.679454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:16.679454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:16.679454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:16.679454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:16.679454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.679454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:16.680583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.680583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:16.680583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:16.680583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:16.680583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:16.680583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:16.680583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:16.680583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:16.680583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:16.680583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:16.680583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:16.680583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:16.680583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:16.680583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:06:16.680583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:06:16.680583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:16.681100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:16.681562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:16.681562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.681562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:16.681562 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:16.681562 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:16.681878 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:16.682151 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.682821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:16.682821 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:16.682821 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:16.682821 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:16.682821 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:16.682821 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:16.682821 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.682821 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:16.683953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.683953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:16.683953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:16.683953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:16.683953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:16.683953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:16.683953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:16.683953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:16.683953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:16.683953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:16.683953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:16.683953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:16.683953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:16.683953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:16.683953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:16.683953 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:16.684419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:16.684419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:16.684419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:16.684419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:16.684419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:16.684419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:16.684419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.684419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:16.685487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.685487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:16.685487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:16.685487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:16.685487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:16.685487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:16.685487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:16.685487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:16.685487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:16.685487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:16.685487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:16.685487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:16.685487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:16.685487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:06:16.685487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:06:16.685487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:16.685926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:16.686440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.686440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:16.729210 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:16.729634 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:16.729888 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:16.730102 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:16.730217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.730594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:16.730594 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:16.730594 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:16.730594 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:16.730594 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:16.730594 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:16.730594 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.730594 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:16.731311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.731311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:16.731311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:16.731311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:16.731311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:16.731311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:16.731311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:16.731311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:16.731311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:16.731311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:16.731311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:16.731311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:16.731311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:16.731311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:06:16.731311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:16.731311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:16.731311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:16.733176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:21.216268 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:21.217963 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:21.219843 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=240 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:06:21.256811 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:21.257099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.257826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:06:21.257826 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:21.257826 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:21.257826 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:21.257826 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:21.257826 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:21.257826 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.257826 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:21.258793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.258793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:21.258793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:21.258793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:21.258793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:21.258793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:21.258793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:21.258793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:21.258793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:21.258793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:21.258793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:21.258793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:21.258793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:21.258793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:06:21.258793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:21.258793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:21.258793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.259411 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:21.670530 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:21.671933 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:21.671933 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:21.672508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.672968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:06:21.672968 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:21.672968 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:21.672968 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:21.672968 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:21.672968 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:21.672968 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.672968 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:21.674067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.674067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:21.674067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:21.674067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:21.674067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:21.674067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:21.674067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:21.674067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:21.674067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:21.674067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:21.674067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:21.674067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:21.674067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:21.674067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:06:21.674067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:21.674067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.675335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:21.676448 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:21.676542 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:06:21.677088 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:21.677368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.678135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:06:21.678135 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:21.678135 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:21.678135 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:21.678135 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:21.678135 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:21.678135 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.678135 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:21.679573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.679573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:21.679573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:21.679573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:21.679573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:21.679573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:21.679573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:21.679573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:21.679573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:21.679573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:21.679573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:21.679573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:21.679573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:21.679573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:21.679573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:21.680160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:21.680160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:21.680160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:21.680160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:21.680160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:21.680160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:21.680160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:21.680160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.680160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:21.682096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.682096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:21.682096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:21.682096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:21.682096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:21.682096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:21.682096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:21.682096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:21.682096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:21.682096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:21.682096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:21.682096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:21.682096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:21.682096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:06:21.682096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:06:21.682096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:21.682593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:21.683209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:21.683209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.683209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:21.683209 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:21.683209 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:21.683209 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:21.683209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.683691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:21.683691 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:21.683691 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:21.683691 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:21.683691 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:21.683691 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:21.683691 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.683691 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:21.684577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.684577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:21.684577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:21.684577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:21.684577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:21.684577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:21.684577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:21.684577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:21.684577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:21.684577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:21.684577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:21.684577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:21.684577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:21.684577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:21.684577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:21.684577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:21.685032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:21.685032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:21.685032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:21.685032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:21.685032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:21.685032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:21.685032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.685032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:21.685575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.685575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:21.685575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:21.685575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:21.685575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:21.685575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:21.685575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:21.685575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:21.685575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:21.685575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:21.685575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:21.685575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:21.685575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:21.685575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:06:21.685575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:06:21.685575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:21.686111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:21.686610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.686610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:21.729932 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:21.730479 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:21.730843 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:21.731292 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:21.731518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.732334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:21.732334 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:21.732334 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:21.732334 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:21.732334 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:21.732334 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:21.732334 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.732334 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:21.733923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.733923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:21.733923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:21.733923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:21.733923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:21.733923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:21.733923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:21.733923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:21.733923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:21.733923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:21.733923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:21.733923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:21.733923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:21.733923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:06:21.733923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:21.733923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:21.733923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:21.735415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:26.216937 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:26.218733 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:26.255689 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:26.256067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.257160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:06:26.257160 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:26.257160 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:26.257160 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:26.257160 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:26.257160 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:26.257160 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.257160 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:26.258889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.258889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:26.258889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:26.258889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:26.258889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:26.258889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:26.258889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:26.258889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:26.258889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:26.258889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:26.258889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:26.258889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:26.258889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:26.258889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:06:26.258889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:26.258889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:26.258889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.259932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:26.671567 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:26.672679 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:26.673175 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:26.673489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.674387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:06:26.674387 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:26.674387 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:26.674387 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:26.674387 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:26.674387 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:26.674387 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.674387 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:26.675453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.675453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:26.675453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:26.675453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:26.675453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:26.675453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:26.675453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:26.675453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:26.675453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:26.675453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:26.675453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:26.675453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:26.675453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:26.675453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:06:26.675453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:26.675453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.676683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:26.677643 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:26.677643 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:06:26.677643 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:26.677941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.678462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:06:26.678462 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:26.678462 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:26.678462 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:26.678462 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:26.678462 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:26.678462 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.678462 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:26.679859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.679859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:26.679859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:26.679859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:26.679859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:26.679859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:26.679859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:26.679859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:26.679859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:26.679859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:26.679859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:26.679859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:26.679859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:26.679859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:26.679859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:26.680599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:26.680599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:26.680599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:26.680599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:26.680599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:26.680599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:26.680599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:26.680599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.680599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:26.681633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.681633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:26.681633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:26.681633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:26.681633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:26.681633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:26.681633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:26.681633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:26.681633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:26.681633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:26.681633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:26.681633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:26.681633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:26.681633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:06:26.681633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:06:26.681633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:26.682198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:26.682703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:26.682703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.682703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:26.682703 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:26.683190 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:26.683655 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:26.683875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.684445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:26.684445 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:26.684445 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:26.684445 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:26.684445 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:26.684445 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:26.684445 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.684445 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:26.685364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.685364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:26.685364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:26.685364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:26.685364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:26.685364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:26.685364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:26.685364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:26.685364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:26.685364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:26.685364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:26.685364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:26.685364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:26.685364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:26.685364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:26.685364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:26.686006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:26.686006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:26.686006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:26.686006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:26.686006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:26.686006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:26.686006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.686006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:26.686541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.686541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:26.686541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:26.686541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:26.686541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:26.686541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:26.686541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:26.686541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:26.686541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:26.686541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:26.686541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:26.686541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:26.686541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:26.686541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:06:26.686541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:06:26.686541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:26.687238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:26.687894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.687894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:26.730798 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:26.731470 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:26.732013 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:26.732483 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:26.732717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.733831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:26.733831 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:26.733831 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:26.733831 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:26.733831 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:26.733831 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:26.733831 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.733831 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:26.734783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.734783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:26.734783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:26.734783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:26.734783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:26.734783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:26.734783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:26.734783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:26.734783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:26.734783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:26.734783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:26.734783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:26.734783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:26.734783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:06:26.734783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:26.734783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:26.734783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:26.736165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:31.217974 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:31.219565 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:31.260404 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:31.261158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.261794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:06:31.261794 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:31.261794 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:31.261794 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:31.261794 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:31.261794 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:31.261794 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.261794 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:31.263562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.263562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:31.263562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:31.263562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:31.263562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:31.263562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:31.263562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:31.263562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:31.263562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:31.263562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:31.263562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:31.263562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:31.263562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:31.263562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:06:31.263562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:31.263562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:31.263562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.265118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:31.672258 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:31.674095 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:31.674445 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:31.675063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.675926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:06:31.675926 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:31.675926 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:31.675926 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:31.675926 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:31.675926 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:31.675926 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.675926 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:31.678223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.678223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:31.678223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:31.678223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:31.678223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:31.678223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:31.678223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:31.678223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:31.678223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:31.678223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:31.678223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:31.678223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:31.678223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:31.678223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:06:31.678223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:31.678223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.679265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:31.680062 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:31.680062 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:06:31.680062 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:31.680062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.680222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:31.680222 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:31.680222 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:31.680222 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:31.680222 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:31.680222 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:31.680222 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.680222 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:31.681353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.681353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:31.681353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:31.681353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:31.681353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:31.681353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:31.681353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:31.681353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:31.681353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:31.681353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:31.681353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:31.681353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:31.681353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:31.681353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:31.681353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:31.681353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:31.682220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:31.682220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:31.682220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:31.682220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:31.682220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:31.682220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:31.682220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.682220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:31.682618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.682618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:31.682618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:31.682618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:31.682618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:31.682618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:31.682618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:31.682618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:31.682618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:31.682618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:31.682618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:31.682618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:31.682618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:31.682618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:06:31.682618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:06:31.682618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:31.683253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:31.684210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:31.684210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.684210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:31.684210 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:31.684210 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:31.684589 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:31.684816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.685437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:31.685437 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:31.685437 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:31.685437 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:31.685437 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:31.685437 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:31.685437 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.685437 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:31.686580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.686580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:31.686580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:31.686580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:31.686580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:31.686580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:31.686580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:31.686580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:31.686580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:31.686580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:31.686580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:31.686580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:31.686580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:31.686580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:31.686580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:31.686580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:31.687376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:31.687376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:31.687376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:31.687376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:31.687376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:31.687376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:31.687376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.687376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:31.688085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.688085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:31.688085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:31.688085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:31.688085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:31.688085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:31.688085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:31.688085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:31.688085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:31.688085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:31.688085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:31.688085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:31.688085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:31.688085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:06:31.688085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:06:31.688085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:31.688703 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:31.689298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.689298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:31.731592 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:31.732484 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:31.733150 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:31.733505 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:31.733685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.734464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:31.734464 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:31.734464 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:31.734464 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:31.734464 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:31.734464 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:31.734464 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.734464 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:31.735925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.735925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:31.735925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:31.735925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:31.735925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:31.735925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:31.735925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:31.735925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:31.735925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:31.735925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:31.735925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:31.735925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:31.735925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:31.735925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:06:31.735925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:31.735925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:31.735925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:31.737326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:36.218769 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:36.220555 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:36.258387 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:36.258387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.259106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:06:36.259106 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:36.259106 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:36.259106 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:36.259106 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:36.259106 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:36.259106 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.259106 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:36.260030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.260030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:36.260030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:36.260030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:36.260030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:36.260030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:36.260030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:36.260030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:36.260030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:36.260030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:36.260030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:36.260030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:36.260030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:36.260030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:06:36.260030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:36.260030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:36.260030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.261132 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:36.673255 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:36.674794 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:36.674954 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:36.675116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.676323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:06:36.676323 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:36.676323 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:36.676323 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:36.676323 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:36.676323 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:36.676323 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.676323 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:36.678205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.678205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:36.678205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:36.678205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:36.678205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:36.678205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:36.678205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:36.678205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:36.678205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:36.678205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:36.678205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:36.678205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:36.678205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:36.678205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:06:36.678205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:36.678205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.679048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:36.679835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:36.680466 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:06:36.680894 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:36.681089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.681523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:36.681523 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:36.681523 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:36.681523 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:36.681523 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:36.681523 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:36.681523 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.681523 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:36.682495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.682495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:36.682495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:36.682495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:36.682495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:36.682495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:36.682495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:36.682495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:36.682495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:36.682495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:36.682495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:36.682495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:36.682495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:36.682495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:36.682495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:36.682495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:36.683391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:36.683391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:36.683391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:36.683391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:36.683391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:36.683391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:36.683391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.683391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:36.683902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.683902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:36.683902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:36.683902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:36.683902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:36.683902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:36.683902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:36.683902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:36.683902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:36.683902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:36.683902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:36.683902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:36.683902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:36.683902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:06:36.683902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:06:36.683902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:36.684670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:36.685343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:36.685343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.685343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:36.685343 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:36.685343 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:36.685601 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:36.685798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.686246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:36.686246 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:36.686246 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:36.686246 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:36.686246 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:36.686246 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:36.686246 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.686246 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:36.686830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.686830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:36.686830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:36.686830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:36.686830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:36.686830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:36.686830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:36.686830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:36.686830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:36.686830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:36.686830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:36.686830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:36.686830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:36.686830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:36.686830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:36.686830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:36.687336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:36.687336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:36.687336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:36.687336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:36.687336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:36.687336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:36.687336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.687336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:36.687561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.687561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:36.687561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:36.687561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:36.687561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:36.687561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:36.687561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:36.687561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:36.687561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:36.687561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:36.687561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:36.687561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:36.687561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:36.687561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:06:36.687561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:06:36.687561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:36.688179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:36.688874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.688874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:36.732477 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:36.733478 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:36.734294 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:36.734664 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:36.734893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.735681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:36.735681 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:36.735681 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:36.735681 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:36.735681 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:36.735681 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:36.735681 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.735681 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:36.737664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.737664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:36.737664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:36.737664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:36.737664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:36.737664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:36.737664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:36.737664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:36.737664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:36.737664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:36.737664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:36.737664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:36.737664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:36.737664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:06:36.737664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:36.737664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:36.737664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:36.738202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:41.219798 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:41.221206 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:41.259263 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:41.259754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.260751 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:06:41.260751 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:41.260751 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:41.260751 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:41.260751 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:41.260751 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:41.260751 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.260751 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:41.262070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.262070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:41.262070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:41.262070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:41.262070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:41.262070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:41.262070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:41.262070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:41.262070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:41.262070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:41.262070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:41.262070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:41.262070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:41.262070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:06:41.262070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:41.262070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:41.262070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.263184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:41.674064 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:41.675725 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:41.676114 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:41.676415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.677773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:06:41.677773 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:41.677773 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:41.677773 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:41.677773 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:41.677773 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:41.677773 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.677773 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:41.679366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.679366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:41.679366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:41.679366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:41.679366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:41.679366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:41.679366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:41.679366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:41.679366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:41.679366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:41.679366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:41.679366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:41.679366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:41.679366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:06:41.679366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:41.679366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.679930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:41.680561 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:41.680883 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:06:41.681482 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:41.681744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.682523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:41.682523 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:41.682523 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:41.682523 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:41.682523 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:41.682523 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:41.682523 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.682523 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:41.683446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.683446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:41.683446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:41.683446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:41.683446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:41.683446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:41.683446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:41.683446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:41.683446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:41.683446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:41.683446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:41.683446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:41.683446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:41.683446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:41.683446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:41.683446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:41.684080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:41.684080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:41.684080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:41.684080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:41.684080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:41.684080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:41.684080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.684080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:41.684570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.684570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:41.684570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:41.684570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:41.684570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:41.684570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:41.684570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:41.684570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:41.684570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:41.684570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:41.684570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:41.684570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:41.684570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:41.684570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:06:41.684570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:06:41.684570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:41.685071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:41.685565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:41.685565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.685565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:41.685565 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:41.685704 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:41.686341 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:41.686663 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.688128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:41.688128 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:41.688128 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:41.688128 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:41.688128 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:41.688128 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:41.688128 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.688128 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:41.689125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.689125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:41.689125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:41.689125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:41.689125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:41.689125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:41.689125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:41.689125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:41.689125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:41.689125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:41.689125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:41.689125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:41.689125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:41.689125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:41.689125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:41.689125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:41.689651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:41.689651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:41.689651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:41.689651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:41.689651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:41.689651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:41.689651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.689651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:41.690198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.690198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:41.690198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:41.690198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:41.690198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:41.690198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:41.690198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:41.690198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:41.690198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:41.690198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:41.690198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:41.690198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:41.690198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:41.690198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:06:41.690198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:06:41.690198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:41.690695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:41.691177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.691177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:41.733274 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:41.733880 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:41.734514 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:41.734973 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:41.735287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.736204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:41.736204 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:41.736204 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:41.736204 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:41.736204 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:41.736204 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:41.736204 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.736204 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:41.737551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.737551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:41.737551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:41.737551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:41.737551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:41.737551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:41.737551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:41.737551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:41.737551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:41.737551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:41.737551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:41.737551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:41.737551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:41.737551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:06:41.737551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:41.737551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:41.737551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:41.738572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:46.220764 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:46.222756 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:46.262579 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:46.262886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.263826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:06:46.263826 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:46.263826 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:46.263826 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:46.263826 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:46.263826 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:46.263826 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.263826 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:46.265515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.265515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:46.265515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:46.265515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:46.265515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:46.265515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:46.265515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:46.265515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:46.265515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:46.265515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:46.265515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:46.265515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:46.265515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:46.265515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:06:46.265515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:46.265515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:46.265515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.267099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:46.674745 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:46.676121 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:46.676415 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:46.676670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.677559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:06:46.677559 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:46.677559 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:46.677559 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:46.677559 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:46.677559 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:46.677559 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.677559 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:46.678875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.678875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:46.678875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:46.678875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:46.678875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:46.678875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:46.678875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:46.678875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:46.678875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:46.678875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:46.678875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:46.678875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:46.678875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:46.678875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:06:46.678875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:46.678875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.679750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:46.680939 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:46.681393 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:06:46.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:46.682368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.683200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:46.683200 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:46.683200 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:46.683200 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:46.683200 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:46.683200 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:46.683200 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.683200 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:46.684706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.684706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:46.684706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:46.684706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:46.684706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:46.684706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:46.684706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:46.684706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:46.684706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:46.684706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:46.684706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:46.684706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:46.684706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:46.684706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:46.684706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:46.684706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:46.685719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:46.685719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:46.685719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:46.685719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:46.685719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:46.685719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:46.685719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.685719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:46.686403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.686403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:46.686403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:46.686403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:46.686403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:46.686403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:46.686403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:46.686403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:46.686403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:46.686403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:46.686403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:46.686403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:46.686403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:46.686403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:06:46.686403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:06:46.686403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:46.686860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:46.687379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:46.687379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.687379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:46.687379 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:46.687379 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:46.687379 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:46.687674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.688249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:46.688249 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:46.688249 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:46.688249 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:46.688249 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:46.688249 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:46.688249 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.688249 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:46.689566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.689566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:46.689566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:46.689566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:46.689566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:46.689566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:46.689566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:46.689566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:46.689566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:46.689566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:46.689566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:46.689566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:46.689566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:46.689566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:46.689566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:46.689566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:46.689963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:46.689963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:46.689963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:46.689963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:46.689963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:46.689963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:46.689963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.689963 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:46.691765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.691765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:46.691765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:46.691765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:46.691765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:46.691765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:46.691765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:46.691765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:46.691765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:46.691765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:46.691765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:46.691765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:46.691765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:46.691765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:06:46.691765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:06:46.691765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:46.692251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:46.692714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.692714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:46.733924 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:46.734629 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:46.735090 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:46.735342 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:46.735497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.736176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:46.736176 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:46.736176 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:46.736176 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:46.736176 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:46.736176 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:46.736176 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.736176 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:46.737914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.737914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:46.737914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:46.737914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:46.737914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:46.737914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:46.737914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:46.737914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:46.737914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:46.737914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:46.737914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:46.737914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:46.737914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:46.737914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:06:46.737914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:46.737914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:46.737914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:46.739206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:51.221945 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:51.223062 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:51.266485 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:51.266758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.267478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:06:51.267478 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:51.267478 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:51.267478 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:51.267478 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:51.267478 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:51.267478 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.267478 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:51.268329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.268329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:51.268329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:51.268329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:51.268329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:51.268329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:51.268329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:51.268329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:51.268329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:51.268329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:51.268329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:51.268329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:51.268329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:51.268329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:06:51.268329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:51.268329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:51.268329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.268925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:51.675441 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:51.677376 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:51.677734 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:51.677978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.679082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:06:51.679082 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:51.679082 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:51.679082 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:51.679082 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:51.679082 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:51.679082 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.679082 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:51.680659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.680659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:51.680659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:51.680659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:51.680659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:51.680659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:51.680659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:51.680659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:51.680659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:51.680659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:51.680659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:51.680659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:51.680659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:51.680659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:06:51.680659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:51.680659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.681536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:51.682461 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:51.682461 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:06:51.682844 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:51.683063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.683541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:51.683541 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:51.683541 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:51.683541 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:51.683541 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:51.683541 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:51.683541 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.683541 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:51.684617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.684617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:51.684617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:51.684617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:51.684617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:51.684617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:51.684617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:51.684617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:51.684617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:51.684617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:51.684617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:51.684617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:51.684617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:51.684617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:51.684617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:51.684617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:51.685521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:51.685521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:51.685521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:51.685521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:51.685521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:51.685521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:51.685521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.685521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:51.685955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.685955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:51.685955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:51.685955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:51.685955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:51.685955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:51.685955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:51.685955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:51.685955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:51.685955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:51.685955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:51.685955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:51.685955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:51.685955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:06:51.685955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:06:51.685955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:51.686767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:51.687726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:51.687726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.687726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:51.687726 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:51.687726 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:51.688212 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:51.688476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.689064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:51.689064 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:51.689064 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:51.689064 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:51.689064 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:51.689064 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:51.689064 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.689064 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:51.690537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.690537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:51.690537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:51.690537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:51.690537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:51.690537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:51.690537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:51.690537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:51.690537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:51.690537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:51.690537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:51.690537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:51.690537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:51.690537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:51.690537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:51.690537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:51.691280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:51.691280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:51.691280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:51.691280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:51.691280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:51.691280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:51.691280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.691280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:51.692496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.692496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:51.692496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:51.692496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:51.692496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:51.692496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:51.692496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:51.692496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:51.692496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:51.692496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:51.692496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:51.692496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:51.692496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:51.692496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:06:51.692496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:06:51.692496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:51.693163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:51.693624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.693624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:51.735377 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:51.735845 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:51.736912 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:51.737510 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:51.737838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.738885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:51.738885 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:51.738885 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:51.738885 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:51.738885 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:51.738885 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:51.738885 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.738885 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:51.740242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.740242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:51.740242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:51.740242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:51.740242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:51.740242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:51.740242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:51.740242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:51.740242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:51.740242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:51.740242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:51.740242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:51.740242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:51.740242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:06:51.740242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:51.740242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:51.740242 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:51.740915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:56.222580 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:56.224387 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:56.259696 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:56.260250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.261405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:06:56.261405 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:56.261405 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:56.261405 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:56.261405 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:56.261405 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:56.261405 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.261405 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:56.262618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.262618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:56.262618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:56.262618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:56.262618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:56.262618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:56.262618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:56.262618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:56.262618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:56.262618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:56.262618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:56.262618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:56.262618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:56.262618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:06:56.262618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:56.262618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:56.262618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.263634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:56.676196 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:56.677717 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:56.678155 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:56.678439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.679486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:06:56.679486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:56.679486 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:56.679486 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:56.679486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:56.679486 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:56.679486 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.679486 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:56.681478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.681478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:56.681478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:56.681478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:56.681478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:56.681478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:56.681478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:56.681478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:56.681478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:56.681478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:56.681478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:56.681478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:56.681478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:56.681478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:06:56.681478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:56.681478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.682270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:56.683185 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:56.683185 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:06:56.683377 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:56.683678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.684483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:56.684483 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:56.684483 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:56.684483 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:56.684483 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:56.684483 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:56.684483 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.684483 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:56.685975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.685975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:56.685975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:56.685975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:56.685975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:56.685975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:56.685975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:56.685975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:56.685975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:56.685975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:56.685975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:56.685975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:56.685975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:56.685975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:56.685975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:56.685975 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:56.687172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:56.687172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:56.687172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:56.687172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:56.687172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:56.687172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:56.687172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.687172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:56.687172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.687172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:56.687172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:56.687172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:56.687172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:56.687172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:56.687172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:56.687172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:56.688226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:56.689201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:56.689201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:56.689201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:56.689201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:56.689201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:56.689201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:56.689201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:56.689201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:56.689201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:56.689201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.689201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:56.689201 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:56.689201 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:56.689918 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:56.689918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:56.690259 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:56.690259 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:56.690259 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:56.690259 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:56.690259 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:56.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:56.691738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.691738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:06:56.691738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:56.691738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:56.691738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:56.691738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:56.691738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:56.691738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:56.691738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:56.691738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:06:56.691738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:56.691738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:06:56.691738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:56.691738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:06:56.691738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:06:56.691738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:56.693370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:06:56.693370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:56.693370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:06:56.693370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:06:56.693370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:56.693370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:06:56.693370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.693370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:06:56.693370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.693370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:56.693370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:56.693370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:56.693370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:56.693370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:56.693370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:56.693370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:56.694313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:56.695398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:56.695398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:56.695398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:56.695398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:56.695398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:56.695398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:56.695398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:56.695398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.695398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:06:56.736130 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:06:56.736593 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:06:56.737149 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:56.737548 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:06:56.737803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.738660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:06:56.738660 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:56.738660 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:06:56.738660 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:06:56.738660 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:56.738660 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:06:56.738660 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.738660 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:06:56.740356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.740356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:06:56.740356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:06:56.740356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:06:56.740356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:06:56.740356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:06:56.740356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:56.740356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:06:56.740356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:06:56.740356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:06:56.740356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:06:56.740356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:06:56.740356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:06:56.740356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:06:56.740356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:06:56.740356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:56.740356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:06:56.741192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:01.223462 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:01.225358 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:01.266863 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:01.267296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.268515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:07:01.268515 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:01.268515 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:01.268515 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:01.268515 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:01.268515 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:01.268515 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.268515 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:01.269828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.269828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:01.269828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:01.269828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:01.269828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:01.269828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:01.269828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:01.269828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:01.269828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:01.269828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:01.269828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:01.269828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:01.269828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:01.269828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:07:01.269828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:01.269828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:01.269828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.270230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:01.677251 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:01.678502 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:01.678742 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:01.678946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.679784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:07:01.679784 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:01.679784 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:01.679784 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:01.679784 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:01.679784 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:01.679784 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.679784 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:01.681568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.681568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:01.681568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:01.681568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:01.681568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:01.681568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:01.681568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:01.681568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:01.681568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:01.681568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:01.681568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:01.681568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:01.681568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:01.681568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:07:01.681568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:01.681568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.682023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:01.682760 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:01.683102 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:07:01.683483 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:01.683659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.684141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:01.684141 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:01.684141 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:01.684141 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:01.684141 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:01.684141 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:01.684141 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.684141 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:01.685095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.685095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:01.685095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:01.685095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:01.685095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:01.685095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:01.685095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:01.685095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:01.685095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:01.685095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:01.685095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:01.685095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:01.685095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:01.685095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:01.685095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:01.685095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:01.685608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:01.685608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:01.685608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:01.685608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:01.685608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:01.685608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:01.685608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.685608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:01.686125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.686125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:01.686125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:01.686125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:01.686125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:01.686125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:01.686125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:01.686125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:01.686125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:01.686125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:01.686125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:01.686125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:01.686125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:01.686125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:07:01.686125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:07:01.686125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:01.686600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:01.687147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:01.687147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.687147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:01.688060 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:01.688629 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:01.689085 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:01.689541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.690110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:01.690110 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:01.690110 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:01.690110 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:01.690110 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:01.690110 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:01.690110 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.690110 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:01.691372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.691372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:01.691372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:01.691372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:01.691372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:01.691372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:01.691372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:01.691372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:01.691372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:01.691372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:01.691372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:01.691372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:01.691372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:01.691372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:01.691372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:01.691372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:01.692363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:01.692363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:01.692363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:01.692363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:01.692363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:01.692363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:01.692363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.692363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:01.692619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.692619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:01.692619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:01.692619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:01.692619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:01.692619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:01.692619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:01.692619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:01.692619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:01.692619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:01.692619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:01.692619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:01.692619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:01.692619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:07:01.692619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:07:01.692619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:01.693149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:01.693695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.693695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:01.737014 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:01.737751 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:01.738523 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:01.738916 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:01.739308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.740221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:01.740221 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:01.740221 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:01.740221 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:01.740221 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:01.740221 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:01.740221 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.740221 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:01.741949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.741949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:01.741949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:01.741949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:01.741949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:01.741949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:01.741949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:01.741949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:01.741949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:01.741949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:01.741949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:01.741949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:01.741949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:01.741949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:07:01.741949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:01.741949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:01.741949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:01.742706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:06.224204 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:06.226041 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:06.256752 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:06.256933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.258376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:07:06.258376 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:06.258376 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:06.258376 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:06.258376 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:06.258376 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:06.258376 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.258376 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:06.259172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.259172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:06.259172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:06.259172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:06.259172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:06.259172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:06.259172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:06.259172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:06.259172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:06.259172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:06.259172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:06.259172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:06.259172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:06.259172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:07:06.259172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:06.259172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:06.259172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.260273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:06.678110 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:06.679680 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:06.680188 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:06.680485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.681921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:07:06.681921 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:06.681921 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:06.681921 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:06.681921 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:06.681921 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:06.681921 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.681921 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:06.683930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.683930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:06.683930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:06.683930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:06.683930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:06.683930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:06.683930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:06.683930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:06.683930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:06.683930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:06.683930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:06.683930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:06.683930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:06.683930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:07:06.683930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:06.683930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.684709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:06.685621 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:06.685621 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:07:06.685813 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:06.686109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.686704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:06.686704 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:06.686704 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:06.686704 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:06.686704 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:06.686704 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:06.686704 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.686704 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:06.688143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.688143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:06.688143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:06.688143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:06.688143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:06.688143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:06.688143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:06.688143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:06.688143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:06.688143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:06.688143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:06.688143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:06.688143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:06.688143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:06.688143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:06.688143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:06.688632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:06.688632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:06.688632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:06.688632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:06.688632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:06.688632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:06.688632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.688632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:06.689919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.689919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:06.689919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:06.689919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:06.689919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:06.689919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:06.689919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:06.689919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:06.689919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:06.689919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:06.689919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:06.689919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:06.689919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:06.689919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:07:06.689919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:07:06.689919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:06.690412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:06.690926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:06.690926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.690926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:06.690926 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:06.690926 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:06.691380 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:06.691879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.692726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:06.692726 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:06.692726 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:06.692726 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:06.692726 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:06.692726 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:06.692726 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.692726 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:06.694167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.694167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:06.694167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:06.694167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:06.694167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:06.694167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:06.694167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:06.694167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:06.694167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:06.694167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:06.694167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:06.694167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:06.694167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:06.694167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:06.694167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:06.694167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:06.694651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:06.694651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:06.694651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:06.694651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:06.694651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:06.694651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:06.694651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.694651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:06.696267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.696267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:06.696267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:06.696267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:06.696267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:06.696267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:06.696267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:06.696267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:06.696267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:06.696267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:06.696267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:06.696267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:06.696267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:06.696267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:07:06.696267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:07:06.696267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:06.696723 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:06.697366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.697366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:06.737609 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:06.738110 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:06.738895 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:06.739496 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:06.739856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.740931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:06.740931 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:06.740931 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:06.740931 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:06.740931 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:06.740931 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:06.740931 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.740931 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:06.742087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.742087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:06.742087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:06.742087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:06.742087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:06.742087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:06.742087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:06.742087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:06.742087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:06.742087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:06.742087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:06.742087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:06.742087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:06.742087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:07:06.742087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:06.742087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:06.742087 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:06.742801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:11.225117 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:11.226622 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:11.265131 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:11.265842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.266214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:07:11.266214 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:11.266214 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:11.266214 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:11.266214 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:11.266214 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:11.266214 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.266214 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:11.268600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.268600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:11.268600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:11.268600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:11.268600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:11.268600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:11.268600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:11.268600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:11.268600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:11.268600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:11.268600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:11.268600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:11.268600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:11.268600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:07:11.268600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:11.268600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:11.268600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.269503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:11.678633 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:11.680054 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:11.680279 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:11.680443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.681490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:07:11.681490 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:11.681490 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:11.681490 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:11.681490 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:11.681490 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:11.681490 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.681490 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:11.683236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.683236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:11.683236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:11.683236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:11.683236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:11.683236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:11.683236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:11.683236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:11.683236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:11.683236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:11.683236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:11.683236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:11.683236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:11.683236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:07:11.683236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:11.683236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.683701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:11.685132 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:11.686221 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:07:11.687194 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:11.687194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.687831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:11.687831 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:11.687831 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:11.687831 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:11.687831 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:11.687831 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:11.687831 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.687831 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:11.688717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.688717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:11.688717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:11.688717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:11.688717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:11.688717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:11.688717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:11.688717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:11.688717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:11.688717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:11.688717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:11.688717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:11.688717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:11.688717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:11.688717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:11.688717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:11.689512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:11.689512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:11.689512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:11.689512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:11.689512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:11.689512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:11.689512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.689512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:11.689512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.689512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:11.689512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:11.689512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:11.689512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:11.689512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:11.689512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:11.689512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:11.690563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:11.691641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:11.691641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:11.691641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:11.691641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:11.691641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:11.691641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:11.691641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:11.691641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:11.691641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:11.691641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.691641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:11.691641 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:11.691641 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:11.692306 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:11.692306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.692928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:11.692928 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:11.692928 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:11.692928 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:11.692928 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:11.692928 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:11.692928 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.692928 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:11.694221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.694221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:11.694221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:11.694221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:11.694221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:11.694221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:11.694221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:11.694221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:11.694221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:11.694221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:11.694221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:11.694221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:11.694221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:11.694221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:11.694221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:11.694221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:11.694880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:11.694880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:11.694880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:11.694880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:11.694880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:11.694880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:11.694880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.694880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:11.695872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.695872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:11.695872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:11.695872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:11.695872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:11.695872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:11.695872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:11.695872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:11.695872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:11.695872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:11.695872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:11.695872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:11.695872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:11.695872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:07:11.695872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:07:11.695872 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:11.696350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:11.696851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.696851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:11.738370 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:11.738999 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:11.739674 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:11.739999 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:11.740198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.740841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:11.740841 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:11.740841 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:11.740841 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:11.740841 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:11.740841 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:11.740841 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.740841 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:11.741897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.741897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:11.741897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:11.741897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:11.741897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:11.741897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:11.741897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:11.741897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:11.741897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:11.741897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:11.741897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:11.741897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:11.741897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:11.741897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:07:11.741897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:11.741897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:11.741897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:11.742819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:16.225740 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:16.226645 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:16.265382 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:16.265586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.266225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:07:16.266225 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:16.266225 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:16.266225 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:16.266225 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:16.266225 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:16.266225 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.266225 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:16.267903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.267903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:16.267903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:16.267903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:16.267903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:16.267903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:16.267903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:16.267903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:16.267903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:16.267903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:16.267903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:16.267903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:16.267903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:16.267903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:07:16.267903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:16.267903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:16.267903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.268493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:16.679790 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:16.681343 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:16.681689 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:16.681969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.683197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:07:16.683197 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:16.683197 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:16.683197 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:16.683197 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:16.683197 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:16.683197 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.683197 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:16.685124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.685124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:16.685124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:16.685124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:16.685124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:16.685124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:16.685124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:16.685124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:16.685124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:16.685124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:16.685124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:16.685124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:16.685124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:16.685124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:07:16.685124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:16.685124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.685873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:16.686719 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:16.686719 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:07:16.686719 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:16.686719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.686954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:16.686954 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:16.686954 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:16.686954 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:16.686954 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:16.686954 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:16.686954 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.686954 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:16.687666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.687666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:16.687666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:16.687666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:16.687666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:16.687666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:16.687666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:16.687666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:16.687666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:16.687666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:16.687666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:16.687666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:16.687666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:16.687666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:16.687666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:16.687666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:16.688592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:16.688592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:16.688592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:16.688592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:16.688592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:16.688592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:16.688592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.688592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:16.688592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.688592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:16.688592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:16.688592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:16.688592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:16.688592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:16.688592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:16.688592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:16.689360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:16.690239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:16.690239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:16.690239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:16.690239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:16.690239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:16.690239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:16.690239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:16.690239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:16.690239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:16.690239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.690239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:16.691308 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:16.691866 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:16.692211 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:16.692442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.693403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:16.693403 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:16.693403 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:16.693403 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:16.693403 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:16.693403 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:16.693403 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.693403 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:16.693759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.693759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:16.693759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:16.693759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:16.693759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:16.693759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:16.693759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:16.693759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:16.693759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:16.693759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:16.693759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:16.693759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:16.693759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:16.693759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:16.693759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:16.693759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:16.694288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:16.694288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:16.694288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:16.694288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:16.694288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:16.694288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:16.694288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.694288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:16.694773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.694773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:16.694773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:16.694773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:16.694773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:16.694773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:16.694773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:16.694773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:16.694773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:16.694773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:16.694773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:16.694773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:16.694773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:16.694773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:07:16.694773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:07:16.694773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:16.695701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:16.696656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.696656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:16.739091 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:16.739543 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:16.740282 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:16.741082 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:16.741082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.741944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:16.741944 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:16.741944 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:16.741944 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:16.741944 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:16.741944 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:16.741944 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.741944 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:16.743728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.743728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:16.743728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:16.743728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:16.743728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:16.743728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:16.743728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:16.743728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:16.743728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:16.743728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:16.743728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:16.743728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:16.743728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:16.743728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:07:16.743728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:16.743728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:16.743728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:16.744565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:21.226338 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:21.227573 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:21.233196 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=241 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:07:21.261803 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:21.262119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.262912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:07:21.262912 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:21.262912 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:21.262912 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:21.262912 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:21.262912 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:21.262912 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.262912 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:21.264810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.264810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:21.264810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:21.264810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:21.264810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:21.264810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:21.264810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:21.264810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:21.264810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:21.264810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:21.264810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:21.264810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:21.264810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:21.264810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:07:21.264810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:21.264810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:21.264810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.265866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:21.680375 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:21.681645 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:21.682038 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:21.682281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.683377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:07:21.683377 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:21.683377 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:21.683377 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:21.683377 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:21.683377 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:21.683377 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.683377 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:21.685139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.685139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:21.685139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:21.685139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:21.685139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:21.685139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:21.685139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:21.685139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:21.685139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:21.685139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:21.685139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:21.685139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:21.685139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:21.685139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:07:21.685139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:21.685139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.686016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:21.687498 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:21.687498 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:07:21.687498 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:21.687498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.687730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:21.687730 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:21.687730 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:21.687730 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:21.687730 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:21.687730 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:21.687730 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.687730 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:21.688895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.688895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:21.688895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:21.688895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:21.688895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:21.688895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:21.688895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:21.688895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:21.688895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:21.688895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:21.688895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:21.688895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:21.688895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:21.688895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:21.688895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:21.688895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:21.689641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:21.689641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:21.689641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:21.689641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:21.689641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:21.689641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:21.689641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.689641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:21.689641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.689641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:21.689641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:21.689641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:21.689641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:21.689641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:21.689641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:21.689641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:21.690259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:21.690747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:21.690747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:21.690747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:21.690747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:21.690747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:21.690747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:21.690747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:21.690747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:21.690747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:21.690747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.690747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:21.691715 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:21.692526 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:21.693089 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:21.693303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.693966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:21.693966 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:21.693966 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:21.693966 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:21.693966 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:21.693966 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:21.693966 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.693966 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:21.695599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.695599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:21.695599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:21.695599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:21.695599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:21.695599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:21.695599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:21.695599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:21.695599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:21.695599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:21.695599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:21.695599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:21.695599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:21.695599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:21.695599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:21.695599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:21.696039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:21.696039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:21.696039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:21.696039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:21.696039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:21.696039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:21.696039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.696039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:21.697631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.697631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:21.697631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:21.697631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:21.697631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:21.697631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:21.697631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:21.697631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:21.697631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:21.697631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:21.697631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:21.697631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:21.697631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:21.697631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:07:21.697631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:07:21.697631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:21.698119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:21.698619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.698619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:21.740021 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:21.740669 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:21.741293 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:21.741756 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:21.742102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.743434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:21.743434 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:21.743434 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:21.743434 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:21.743434 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:21.743434 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:21.743434 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.743434 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:21.745250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.745250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:21.745250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:21.745250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:21.745250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:21.745250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:21.745250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:21.745250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:21.745250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:21.745250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:21.745250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:21.745250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:21.745250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:21.745250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:07:21.745250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:21.745250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:21.745250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:21.746124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:26.226967 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:26.228253 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:26.259090 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:26.259297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.259685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:07:26.259685 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:26.259685 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:26.259685 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:26.259685 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:26.259685 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:26.259685 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.259685 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:26.260515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.260515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:26.260515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:26.260515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:26.260515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:26.260515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:26.260515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:26.260515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:26.260515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:26.260515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:26.260515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:26.260515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:26.260515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:26.260515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:07:26.260515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:26.260515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:26.260515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.261773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:26.681161 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:26.682297 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:26.682631 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:26.682869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.683763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:07:26.683763 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:26.683763 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:26.683763 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:26.683763 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:26.683763 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:26.683763 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.683763 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:26.685248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.685248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:26.685248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:26.685248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:26.685248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:26.685248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:26.685248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:26.685248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:26.685248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:26.685248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:26.685248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:26.685248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:26.685248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:26.685248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:07:26.685248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:26.685248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.686173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:26.687017 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:26.687668 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:07:26.687936 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:26.688267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.689056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:26.689056 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:26.689056 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:26.689056 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:26.689056 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:26.689056 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:26.689056 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.689056 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:26.689980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.689980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:26.689980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:26.689980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:26.689980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:26.689980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:26.689980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:26.689980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:26.689980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:26.689980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:26.689980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:26.689980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:26.689980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:26.689980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:26.689980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:26.689980 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:26.690922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:26.690922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:26.690922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:26.690922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:26.690922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:26.690922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:26.690922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.690922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:26.690922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.690922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:26.690922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:26.690922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:26.690922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:26.690922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:26.690922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:26.690922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:26.691863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:26.692941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:26.692941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:26.692941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:26.692941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:26.692941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:26.692941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:26.692941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:26.692941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:26.692941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:26.692941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.692941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:26.692941 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:26.692941 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:26.693353 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:26.693353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.694079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:26.694079 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:26.694079 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:26.694079 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:26.694079 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:26.694079 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:26.694079 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.694079 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:26.695056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.695056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:26.695056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:26.695056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:26.695056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:26.695056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:26.695056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:26.695056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:26.695056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:26.695056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:26.695056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:26.695056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:26.695056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:26.695056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:26.695056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:26.695056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:26.695514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:26.695514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:26.695514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:26.695514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:26.695514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:26.695514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:26.695514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.695514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:26.696127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.696127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:26.696127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:26.696127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:26.696127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:26.696127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:26.696127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:26.696127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:26.696127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:26.696127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:26.696127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:26.696127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:26.696127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:26.696127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:07:26.696127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:07:26.696127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:26.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:26.697152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.697152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:26.740661 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:26.741514 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:26.742555 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:26.742970 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:26.743230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.744054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:26.744054 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:26.744054 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:26.744054 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:26.744054 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:26.744054 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:26.744054 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.744054 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:26.746347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.746347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:26.746347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:26.746347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:26.746347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:26.746347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:26.746347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:26.746347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:26.746347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:26.746347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:26.746347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:26.746347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:26.746347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:26.746347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:07:26.746347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:26.746347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:26.746347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:26.746882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:31.227916 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:31.230072 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:31.265690 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:31.266116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.266786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:07:31.266786 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:31.266786 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:31.266786 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:31.266786 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:31.266786 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:31.266786 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.266786 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:31.267732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.267732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:31.267732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:31.267732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:31.267732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:31.267732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:31.267732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:31.267732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:31.267732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:31.267732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:31.267732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:31.267732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:31.267732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:31.267732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:07:31.267732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:31.267732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:31.267732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.268617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:31.681727 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:31.682803 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:31.683124 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:31.683651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.684156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:07:31.684156 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:31.684156 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:31.684156 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:31.684156 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:31.684156 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:31.684156 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.684156 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:31.685899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.685899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:31.685899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:31.685899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:31.685899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:31.685899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:31.685899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:31.685899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:31.685899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:31.685899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:31.685899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:31.685899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:31.685899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:31.685899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:07:31.685899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:31.685899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.686545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:31.687205 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:31.687868 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:07:31.688135 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:31.688316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.688937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:31.688937 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:31.688937 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:31.688937 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:31.688937 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:31.688937 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:31.688937 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.688937 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:31.690636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.690636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:31.690636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:31.690636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:31.690636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:31.690636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:31.690636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:31.690636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:31.690636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:31.690636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:31.690636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:31.690636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:31.690636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:31.690636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:31.690636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:31.690636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:31.691323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:31.691323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:31.691323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:31.691323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:31.691323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:31.691323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:31.691323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.691323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:31.691323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.691323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:31.691323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:31.691323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:31.691323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:31.691323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:31.691323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:31.691323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:31.691756 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:31.692313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:31.692313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:31.692313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:31.692313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:31.692313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:31.692313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:31.692313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:31.692313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:31.692313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:31.692313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.692313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:31.692732 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:31.693374 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:31.693958 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:31.694457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.695178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:31.695178 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:31.695178 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:31.695178 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:31.695178 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:31.695178 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:31.695178 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.695178 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:31.695912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.695912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:31.695912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:31.695912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:31.695912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:31.695912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:31.695912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:31.695912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:31.695912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:31.695912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:31.695912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:31.695912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:31.695912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:31.695912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:31.695912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:31.695912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:31.696408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:31.696408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:31.696408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:31.696408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:31.696408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:31.696408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:31.696408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.696408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:31.697006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.697006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:31.697006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:31.697006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:31.697006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:31.697006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:31.697006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:31.697006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:31.697006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:31.697006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:31.697006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:31.697006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:31.697006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:31.697006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:07:31.697006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:07:31.697006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:31.697482 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:31.698044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.698044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:31.741417 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:31.742005 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:31.742402 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:31.742632 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:31.742757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.743326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:31.743326 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:31.743326 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:31.743326 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:31.743326 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:31.743326 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:31.743326 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.743326 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:31.744777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.744777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:31.744777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:31.744777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:31.744777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:31.744777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:31.744777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:31.744777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:31.744777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:31.744777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:31.744777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:31.744777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:31.744777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:31.744777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:07:31.744777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:31.744777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:31.744777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:31.745470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:36.228432 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:36.229657 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:36.265087 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:36.265377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.266011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:07:36.266011 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:36.266011 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:36.266011 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:36.266011 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:36.266011 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:36.266011 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.266011 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:36.266935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.266935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:36.266935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:36.266935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:36.266935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:36.266935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:36.266935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:36.266935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:36.266935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:36.266935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:36.266935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:36.266935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:36.266935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:36.266935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:07:36.266935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:36.266935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:36.266935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.268621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:36.682472 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:36.683891 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:36.684251 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:36.684490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.685568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:07:36.685568 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:36.685568 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:36.685568 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:36.685568 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:36.685568 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:36.685568 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.685568 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:36.687512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.687512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:36.687512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:36.687512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:36.687512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:36.687512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:36.687512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:36.687512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:36.687512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:36.687512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:36.687512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:36.687512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:36.687512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:36.687512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:07:36.687512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:36.687512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.688309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:36.689310 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:36.689310 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:07:36.689310 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:36.689549 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.690332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:36.690332 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:36.690332 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:36.690332 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:36.690332 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:36.690332 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:36.690332 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.690332 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:36.691943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.691943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:36.691943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:36.691943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:36.691943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:36.691943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:36.691943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:36.691943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:36.691943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:36.691943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:36.691943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:36.691943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:36.691943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:36.691943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:36.691943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:36.691943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:36.692516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:36.692516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:36.692516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:36.692516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:36.692516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:36.692516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:36.692516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.692516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:36.694268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.694268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:36.694268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:36.694268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:36.694268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:36.694268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:36.694268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:36.694268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:36.694268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:36.694268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:36.694268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:36.694268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:36.694268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:36.694268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:07:36.694268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:07:36.694268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:36.694976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:36.695722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:36.695722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.695722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:36.695722 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:36.695722 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:36.695944 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:36.696256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.697120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:36.697120 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:36.697120 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:36.697120 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:36.697120 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:36.697120 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:36.697120 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.697120 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:36.698418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.698418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:36.698418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:36.698418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:36.698418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:36.698418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:36.698418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:36.698418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:36.698418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:36.698418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:36.698418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:36.698418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:36.698418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:36.698418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:36.698418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:36.698418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:36.698857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:36.698857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:36.698857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:36.698857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:36.698857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:36.698857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:36.698857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.698857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:36.700091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.700091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:36.700091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:36.700091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:36.700091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:36.700091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:36.700091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:36.700091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:36.700091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:36.700091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:36.700091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:36.700091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:36.700091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:36.700091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:07:36.700091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:07:36.700091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:36.700678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:36.701192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.701192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:36.742127 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:36.742634 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:36.743335 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:36.743612 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:36.743768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.744400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:36.744400 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:36.744400 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:36.744400 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:36.744400 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:36.744400 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:36.744400 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.744400 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:36.746080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.746080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:36.746080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:36.746080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:36.746080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:36.746080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:36.746080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:36.746080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:36.746080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:36.746080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:36.746080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:36.746080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:36.746080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:36.746080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:07:36.746080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:36.746080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:36.746080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:36.747287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:41.229248 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:41.230818 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:41.271111 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:41.271348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.272099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:07:41.272099 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:41.272099 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:41.272099 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:41.272099 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:41.272099 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:41.272099 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.272099 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:41.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:41.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:41.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:41.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:41.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:41.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:41.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:41.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:41.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:41.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:41.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:41.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:41.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:07:41.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:41.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:41.273443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.274724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:41.683273 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:41.685321 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:41.685808 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:41.686192 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.687373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:07:41.687373 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:41.687373 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:41.687373 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:41.687373 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:41.687373 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:41.687373 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.687373 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:41.688666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.688666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:41.688666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:41.688666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:41.688666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:41.688666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:41.688666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:41.688666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:41.688666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:41.688666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:41.688666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:41.688666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:41.688666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:41.688666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:07:41.688666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:41.688666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.689514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:41.690207 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:41.690207 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:07:41.690207 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:41.690373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.691177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:07:41.691177 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:41.691177 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:41.691177 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:41.691177 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:41.691177 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:41.691177 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.691177 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:41.691941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.691941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:41.691941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:41.691941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:41.691941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:41.691941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:41.691941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:41.691941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:41.691941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:41.691941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:41.691941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:41.691941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:41.691941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:41.691941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:41.691941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:41.692652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:41.692652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:41.692652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:41.692652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:41.692652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:41.692652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:41.692652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:41.692652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.692652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:41.693113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.693113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:41.693113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:41.693113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:41.693113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:41.693113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:41.693113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:41.693113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:41.693113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:41.693113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:41.693113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:41.693113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:41.693113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:41.693113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:07:41.693113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:07:41.693113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:41.693796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:41.694548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:41.694548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.694548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:41.695131 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:41.695912 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:41.696787 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:41.697215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.697908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:41.697908 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:41.697908 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:41.697908 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:41.697908 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:41.697908 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:41.697908 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.697908 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:41.699090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.699090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:41.699090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:41.699090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:41.699090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:41.699090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:41.699090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:41.699090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:41.699090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:41.699090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:41.699090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:41.699090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:41.699090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:41.699090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:41.699090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:41.699090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:41.699571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:41.699571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:41.699571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:41.699571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:41.699571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:41.699571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:41.699571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.699571 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:41.700308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.700308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:41.700308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:41.700308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:41.700308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:41.700308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:41.700308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:41.700308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:41.700308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:41.700308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:41.700308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:41.700308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:41.700308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:41.700308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:07:41.700308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:07:41.700308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:41.700852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:41.701510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.701510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:41.742849 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:41.743607 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:41.745166 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:41.745604 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:41.745862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.747101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:41.747101 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:41.747101 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:41.747101 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:41.747101 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:41.747101 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:41.747101 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.747101 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:41.749286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.749286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:41.749286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:41.749286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:41.749286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:41.749286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:41.749286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:41.749286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:41.749286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:41.749286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:41.749286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:41.749286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:41.749286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:41.749286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:07:41.749286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:41.749286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:41.749286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:41.750399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:46.229834 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:46.231627 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:46.266560 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:46.266813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.267357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:07:46.267357 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:46.267357 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:46.267357 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:46.267357 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:46.267357 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:46.267357 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.267357 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:46.268513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.268513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:46.268513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:46.268513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:46.268513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:46.268513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:46.268513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:46.268513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:46.268513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:46.268513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:46.268513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:46.268513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:46.268513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:46.268513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:07:46.268513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:46.268513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:46.268513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.269543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:46.684649 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:46.685860 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:46.686165 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:46.686389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.687291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:07:46.687291 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:46.687291 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:46.687291 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:46.687291 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:46.687291 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:46.687291 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.687291 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:46.689009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.689009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:46.689009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:46.689009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:46.689009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:46.689009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:46.689009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:46.689009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:46.689009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:46.689009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:46.689009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:46.689009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:46.689009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:46.689009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:07:46.689009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:46.689009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.689786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:46.690659 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:46.690659 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:07:46.690659 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:46.690826 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.691615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:46.691615 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:46.691615 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:46.691615 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:46.691615 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:46.691615 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:46.691615 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.691615 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:46.692937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.692937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:46.692937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:46.692937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:46.692937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:46.692937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:46.692937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:46.692937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:46.692937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:46.692937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:46.692937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:46.692937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:46.692937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:46.692937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:46.692937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:46.692937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:46.693455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:46.693455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:46.693455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:46.693455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:46.693455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:46.693455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:46.693455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.693455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:46.693925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.693925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:46.693925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:46.693925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:46.693925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:46.693925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:46.693925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:46.693925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:46.693925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:46.693925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:46.693925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:46.693925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:46.693925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:46.693925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:07:46.693925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:07:46.693925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:46.694451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:46.694931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:46.694931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.694931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:46.695651 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:46.696265 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:46.696771 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:46.696999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.697590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:46.697590 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:46.697590 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:46.697590 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:46.697590 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:46.697590 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:46.697590 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.697590 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:46.698511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.698511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:46.698511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:46.698511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:46.698511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:46.698511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:46.698511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:46.698511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:46.698511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:46.698511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:46.698511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:46.698511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:46.698511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:46.698511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:46.698511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:46.698511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:46.699028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:46.699028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:46.699028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:46.699028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:46.699028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:46.699028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:46.699028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.699028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:46.699575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.699575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:46.699575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:46.699575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:46.699575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:46.699575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:46.699575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:46.699575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:46.699575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:46.699575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:46.699575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:46.699575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:46.699575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:46.699575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:07:46.699575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:07:46.699575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:46.700063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:46.700644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.700644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:46.743871 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:46.744426 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:46.745076 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:46.745439 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:46.745669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.746400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:46.746400 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:46.746400 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:46.746400 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:46.746400 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:46.746400 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:46.746400 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.746400 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:46.747478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.747478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:46.747478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:46.747478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:46.747478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:46.747478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:46.747478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:46.747478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:46.747478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:46.747478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:46.747478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:46.747478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:46.747478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:46.747478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:07:46.747478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:46.747478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:46.747478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:46.748376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:51.230456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:51.232549 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:51.271186 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:51.271604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.272740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:07:51.272740 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:51.272740 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:51.272740 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:51.272740 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:51.272740 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:51.272740 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.272740 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:51.274542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.274542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:51.274542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:51.274542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:51.274542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:51.274542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:51.274542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:51.274542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:51.274542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:51.274542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:51.274542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:51.274542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:51.274542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:51.274542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:07:51.274542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:51.274542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:51.274542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.275657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:51.685510 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:51.686662 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:51.687336 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:51.687509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.688548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:07:51.688548 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:51.688548 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:51.688548 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:51.688548 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:51.688548 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:51.688548 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.688548 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:51.691502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.691502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:51.691502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:51.691502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:51.691502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:51.691502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:51.691502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:51.691502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:51.691502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:51.691502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:51.691502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:51.691502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:51.691502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:51.691502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:07:51.691502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:51.691502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.692235 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:51.692844 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:51.692844 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:07:51.692955 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:51.693236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.693881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:51.693881 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:51.693881 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:51.693881 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:51.693881 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:51.693881 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:51.693881 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.693881 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:51.695352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.695352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:51.695352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:51.695352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:51.695352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:51.695352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:51.695352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:51.695352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:51.695352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:51.695352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:51.695352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:51.695352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:51.695352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:51.695352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:51.695352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:51.695352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:51.696093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:51.696093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:51.696093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:51.696093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:51.696093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:51.696093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:51.696093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.696093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:51.697372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.697372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:51.697372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:51.697372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:51.697372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:51.697372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:51.697372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:51.697372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:51.697372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:51.697372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:51.697372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:51.697372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:51.697372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:51.697372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:07:51.697372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:07:51.697372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:51.697923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:51.698444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:51.698444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.698444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:51.698444 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:51.698444 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:51.698444 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:51.698444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.698926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:51.698926 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:51.698926 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:51.698926 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:51.698926 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:51.698926 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:51.698926 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.698926 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:51.699659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.699659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:51.699659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:51.699659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:51.699659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:51.699659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:51.699659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:51.699659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:51.699659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:51.699659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:51.699659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:51.699659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:51.699659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:51.699659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:51.699659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:51.699659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:51.700173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:51.700173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:51.700173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:51.700173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:51.700173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:51.700173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:51.700173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.700173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:51.700692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.700692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:51.700692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:51.700692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:51.700692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:51.700692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:51.700692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:51.700692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:51.700692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:51.700692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:51.700692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:51.700692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:51.700692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:51.700692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:07:51.700692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:07:51.700692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:51.701248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:51.701855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.701855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:51.744425 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:51.745167 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:51.745623 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:51.745847 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:51.745967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.746602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:51.746602 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:51.746602 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:51.746602 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:51.746602 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:51.746602 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:51.746602 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.746602 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:51.748246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.748246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:51.748246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:51.748246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:51.748246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:51.748246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:51.748246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:51.748246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:51.748246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:51.748246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:51.748246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:51.748246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:51.748246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:51.748246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:07:51.748246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:51.748246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:51.748246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:51.748799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:56.231257 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:56.233067 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:56.273210 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:56.273636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.274665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:07:56.274665 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:56.274665 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:56.274665 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:56.274665 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:56.274665 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:56.274665 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.274665 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:56.275835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.275835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:56.275835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:56.275835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:56.275835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:56.275835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:56.275835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:56.275835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:56.275835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:56.275835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:56.275835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:56.275835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:56.275835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:56.275835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:07:56.275835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:56.275835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:56.275835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.276638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:56.686075 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:56.687900 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:56.688315 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:56.688562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.689660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:07:56.689660 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:56.689660 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:56.689660 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:56.689660 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:56.689660 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:56.689660 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.689660 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:56.691534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.691534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:56.691534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:56.691534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:56.691534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:56.691534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:56.691534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:56.691534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:56.691534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:56.691534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:56.691534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:56.691534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:56.691534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:56.691534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:07:56.691534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:56.691534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.692292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:56.692816 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:56.692816 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:07:56.693242 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:56.693544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.694328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:56.694328 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:56.694328 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:56.694328 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:56.694328 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:56.694328 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:56.694328 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.694328 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:56.695835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.695835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:56.695835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:56.695835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:56.695835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:56.695835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:56.695835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:56.695835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:56.695835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:56.695835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:56.695835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:56.695835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:56.695835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:56.695835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:56.695835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:56.695835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:56.696393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:56.696393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:56.696393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:56.696393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:56.696393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:56.696393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:56.696393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.696393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:56.697729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.697729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:56.697729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:56.697729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:56.697729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:56.697729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:56.697729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:56.697729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:56.697729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:56.697729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:56.697729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:56.697729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:56.697729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:56.697729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:07:56.697729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:07:56.697729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:56.698263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:56.698788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:56.698788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.698788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:56.698788 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:56.698788 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:56.699192 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:56.699460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.700046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:56.700046 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:56.700046 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:56.700046 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:56.700046 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:56.700046 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:56.700046 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.700046 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:56.701088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.701088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:07:56.701088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:56.701088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:56.701088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:56.701088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:56.701088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:56.701088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:56.701088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:56.701088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:07:56.701088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:56.701088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:07:56.701088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:56.701088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:07:56.701088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:07:56.701088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:56.701631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:07:56.701631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:56.701631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:07:56.701631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:07:56.701631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:56.701631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:07:56.701631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.701631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:07:56.702233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.702233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:56.702233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:56.702233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:56.702233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:56.702233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:56.702233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:56.702233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:56.702233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:56.702233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:56.702233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:56.702233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:56.702233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:56.702233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:07:56.702233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:07:56.702233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:56.702700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:56.703352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.703352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:07:56.745488 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:07:56.746201 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:07:56.746903 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:56.747306 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:07:56.747533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.748460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:07:56.748460 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:56.748460 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:07:56.748460 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:07:56.748460 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:56.748460 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:07:56.748460 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.748460 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:07:56.750441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.750441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:07:56.750441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:07:56.750441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:07:56.750441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:07:56.750441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:07:56.750441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:56.750441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:07:56.750441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:07:56.750441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:07:56.750441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:07:56.750441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:07:56.750441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:07:56.750441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:07:56.750441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:07:56.750441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:56.750441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:07:56.751563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:01.231903 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:01.234253 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:01.271179 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:01.271656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.272753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:08:01.272753 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:01.272753 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:01.272753 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:01.272753 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:01.272753 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:01.272753 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.272753 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:01.273815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.273815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:01.273815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:01.273815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:01.273815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:01.273815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:01.273815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:01.273815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:01.273815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:01.273815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:01.273815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:01.273815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:01.273815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:01.273815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:08:01.273815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:01.273815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:01.273815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.274734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:01.686882 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:01.687887 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:01.688141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:01.688313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.689283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:08:01.689283 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:01.689283 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:01.689283 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:01.689283 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:01.689283 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:01.689283 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.689283 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:01.690945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.690945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:01.690945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:01.690945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:01.690945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:01.690945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:01.690945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:01.690945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:01.690945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:01.690945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:01.690945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:01.690945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:01.690945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:01.690945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:08:01.690945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:01.690945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.691465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:01.693089 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:01.693143 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:08:01.693682 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:01.693682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.694280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:01.694280 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:01.694280 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:01.694280 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:01.694280 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:01.694280 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:01.694280 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.694280 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:01.695167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.695167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:01.695167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:01.695167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:01.695167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:01.695167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:01.695167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:01.695167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:01.695167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:01.695167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:01.695167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:01.695167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:01.695167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:01.695167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:01.695167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:01.695167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:01.695798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:01.695798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:01.695798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:01.695798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:01.695798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:01.695798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:01.695798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.695798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:01.696170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.696170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:01.696170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:01.696170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:01.696170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:01.696170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:01.696170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:01.696170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:01.696170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:01.696170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:01.696170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:01.696170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:01.696170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:01.696170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:08:01.696170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:08:01.696170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:01.697081 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:01.697853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:01.697853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.697853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:01.698533 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:01.699206 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:01.699553 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:01.699847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.700294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:01.700294 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:01.700294 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:01.700294 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:01.700294 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:01.700294 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:01.700294 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.700294 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:01.701267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.701267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:01.701267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:01.701267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:01.701267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:01.701267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:01.701267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:01.701267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:01.701267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:01.701267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:01.701267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:01.701267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:01.701267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:01.701267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:01.701267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:01.701267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:01.701884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:01.701884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:01.701884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:01.701884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:01.701884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:01.701884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:01.701884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.701884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:01.702857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.702857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:01.702857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:01.702857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:01.702857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:01.702857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:01.702857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:01.702857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:01.702857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:01.702857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:01.702857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:01.702857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:01.702857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:01.702857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:08:01.702857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:08:01.702857 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:01.703775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:01.704552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.704552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:01.746486 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:01.747170 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:01.747594 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:01.747975 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:01.748275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.749340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:01.749340 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:01.749340 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:01.749340 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:01.749340 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:01.749340 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:01.749340 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.749340 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:01.750784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.750784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:01.750784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:01.750784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:01.750784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:01.750784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:01.750784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:01.750784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:01.750784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:01.750784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:01.750784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:01.750784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:01.750784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:01.750784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:08:01.750784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:01.750784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:01.750784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:01.751273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:06.232829 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:06.234354 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:06.267915 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:06.268241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.268970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:08:06.268970 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:06.268970 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:06.268970 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:06.268970 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:06.268970 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:06.268970 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.268970 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:06.270167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.270167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:06.270167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:06.270167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:06.270167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:06.270167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:06.270167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:06.270167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:06.270167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:06.270167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:06.270167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:06.270167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:06.270167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:06.270167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:08:06.270167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:06.270167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:06.270167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.271193 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:06.687966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:06.689680 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:06.690019 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:06.690336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.691630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:08:06.691630 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:06.691630 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:06.691630 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:06.691630 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:06.691630 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:06.691630 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.691630 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:06.694148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.694148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:06.694148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:06.694148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:06.694148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:06.694148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:06.694148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:06.694148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:06.694148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:06.694148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:06.694148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:06.694148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:06.694148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:06.694148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:08:06.694148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:06.694148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.694908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:06.695902 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:06.695902 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:08:06.695902 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:06.695902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.696661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:08:06.696661 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:06.696661 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:06.696661 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:06.696661 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:06.696661 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:06.696661 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.696661 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:06.697633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.697633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:06.697633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:06.697633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:06.697633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:06.697633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:06.697633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:06.697633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:06.697633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:06.697633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:06.697633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:06.697633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:06.697633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:06.697633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:06.697633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:06.698413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:06.698413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:06.698413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:06.698413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:06.698413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:06.698413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:06.698413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:06.698413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.698413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:06.698861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.698861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:06.698861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:06.698861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:06.698861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:06.698861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:06.698861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:06.698861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:06.698861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:06.698861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:06.698861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:06.698861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:06.698861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:06.698861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:08:06.698861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:08:06.698861 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:06.699728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:06.700605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:06.700605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.700605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:06.700605 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:06.700605 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:06.700605 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:06.700605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.701072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:08:06.701072 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:06.701072 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:06.701072 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:06.701072 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:06.701072 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:06.701072 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.701072 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:06.701908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.701908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:06.701908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:06.701908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:06.701908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:06.701908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:06.701908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:06.701908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:06.701908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:06.701908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:06.701908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:06.701908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:06.701908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:06.701908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:06.701908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:06.702593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:06.702593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:06.702593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:06.702593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:06.702593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:06.702593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:06.702593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:06.702593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.702593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:06.703653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.703653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:06.703653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:06.703653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:06.703653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:06.703653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:06.703653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:06.703653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:06.703653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:06.703653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:06.703653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:06.703653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:06.703653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:06.703653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:08:06.703653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:08:06.703653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:06.704146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:06.704506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.704506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:06.747138 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:06.747602 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:06.748176 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:06.748602 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:06.748842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.749591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:06.749591 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:06.749591 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:06.749591 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:06.749591 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:06.749591 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:06.749591 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.749591 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:06.751688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.751688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:06.751688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:06.751688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:06.751688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:06.751688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:06.751688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:06.751688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:06.751688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:06.751688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:06.751688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:06.751688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:06.751688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:06.751688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:08:06.751688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:06.751688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:06.751688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:06.752747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:11.233456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:11.235535 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:11.271628 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:11.272065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.272892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:08:11.272892 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:11.272892 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:11.272892 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:11.272892 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:11.272892 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:11.272892 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.272892 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:11.274171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.274171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:11.274171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:11.274171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:11.274171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:11.274171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:11.274171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:11.274171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:11.274171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:11.274171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:11.274171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:11.274171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:11.274171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:11.274171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:08:11.274171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:11.274171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:11.274171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.275169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:11.688820 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:11.690215 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:11.690475 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:11.690688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.692007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:11.692007 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:11.692007 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:11.692007 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:11.692007 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:11.692007 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:11.692007 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.692007 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:11.693066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.693066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:11.693066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:11.693066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:11.693066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:11.693066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:11.693066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:11.693066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:11.693066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:11.693066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:11.693066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:11.693066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:11.693066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:11.693066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:08:11.693066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:11.693066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:11.693066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.693716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:11.694978 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:11.695654 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:08:11.696123 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:11.696406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.697000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:08:11.697000 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:11.697000 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:11.697000 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:11.697000 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:11.697000 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:11.697000 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.697000 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:11.698021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.698021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:11.698021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:11.698021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:11.698021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:11.698021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:11.698021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:11.698021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:11.698021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:11.698021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:11.698021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:11.698021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:11.698021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:11.698021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:11.698021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:11.698485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:11.698485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:11.698485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:11.698485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:11.698485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:11.698485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:11.698485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:11.698485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.698485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:11.699288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.699288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:11.699288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:11.699288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:11.699288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:11.699288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:11.699288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:11.699288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:11.699288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:11.699288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:11.699288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:11.699288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:11.699288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:11.699288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:08:11.699288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:08:11.699288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:11.699739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:11.700399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:11.700399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.700399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:11.700399 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:11.700399 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:11.700399 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:11.700685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.701173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:11.701173 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:11.701173 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:11.701173 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:11.701173 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:11.701173 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:11.701173 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.701173 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:11.701739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.701739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:11.701739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:11.701739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:11.701739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:11.701739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:11.701739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:11.701739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:11.701739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:11.701739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:11.701739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:11.701739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:11.701739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:11.701739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:11.701739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:11.701739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:11.702229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:11.702229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:11.702229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:11.702229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:11.702229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:11.702229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:11.702229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.702229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:11.702442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.702442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:11.702442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:11.702442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:11.702442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:11.702442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:11.702442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:11.702442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:11.702442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:11.702442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:11.702442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:11.702442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:11.702442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:11.702442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:08:11.702442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:08:11.702442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:11.702856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:11.703353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.703353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:11.747657 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:11.748776 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:11.749614 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:11.750146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:11.750404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.751326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:11.751326 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:11.751326 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:11.751326 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:11.751326 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:11.751326 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:11.751326 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.751326 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:11.753799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.753799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:11.753799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:11.753799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:11.753799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:11.753799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:11.753799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:11.753799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:11.753799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:11.753799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:11.753799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:11.753799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:11.753799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:11.753799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:08:11.753799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:11.753799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:11.753799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:11.754584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:16.234569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:16.235702 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:16.272441 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:16.272966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.273935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:08:16.273935 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:16.273935 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:16.273935 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:16.273935 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:16.273935 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:16.273935 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.273935 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:16.275265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.275265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:16.275265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:16.275265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:16.275265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:16.275265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:16.275265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:16.275265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:16.275265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:16.275265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:16.275265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:16.275265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:16.275265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:16.275265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:08:16.275265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:16.275265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:16.275265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.275887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:16.689522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:16.691832 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:16.692230 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:16.692575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.693724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:16.693724 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:16.693724 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:16.693724 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:16.693724 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:16.693724 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:16.693724 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.693724 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:16.695700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.695700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:16.695700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:16.695700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:16.695700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:16.695700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:16.695700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:16.695700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:16.695700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:16.695700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:16.695700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:16.695700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:16.695700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:16.695700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:08:16.695700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:16.695700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:16.695700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.696797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:16.697926 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:16.697926 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:08:16.697926 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:16.697926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.697926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:16.697926 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:16.697926 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:16.697926 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:16.697926 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:16.697926 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:16.697926 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.697926 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:16.699201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.699201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:16.699201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:16.699201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:16.699201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:16.699201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:16.699201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:16.699201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:16.699201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:16.699201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:16.699201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:16.699201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:16.699201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:16.699201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:16.699201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:16.699201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:16.700155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:16.700155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:16.700155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:16.700155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:16.700155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:16.700155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:16.700155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.700155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:16.700713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.700713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:16.700713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:16.700713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:16.700713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:16.700713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:16.700713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:16.700713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:16.700713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:16.700713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:16.700713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:16.700713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:16.700713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:16.700713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:08:16.700713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:08:16.700713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:16.701498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:16.702062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:16.702062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.702062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:16.702062 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:16.702062 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:16.702578 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:16.702956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.703925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:16.703925 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:16.703925 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:16.703925 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:16.703925 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:16.703925 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:16.703925 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.703925 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:16.705228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.705228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:16.705228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:16.705228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:16.705228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:16.705228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:16.705228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:16.705228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:16.705228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:16.705228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:16.705228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:16.705228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:16.705228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:16.705228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:16.705228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:16.705228 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:16.705694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:16.705694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:16.705694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:16.705694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:16.705694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:16.705694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:16.705694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.705694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:16.706760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.706760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:16.706760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:16.706760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:16.706760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:16.706760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:16.706760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:16.706760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:16.706760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:16.706760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:16.706760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:16.706760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:16.706760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:16.706760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:08:16.706760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:08:16.706760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:16.707335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:16.707859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.707859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:16.748313 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:16.748917 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:16.749557 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:16.749964 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:16.750250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.751466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:16.751466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:16.751466 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:16.751466 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:16.751466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:16.751466 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:16.751466 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.751466 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:16.753493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.753493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:16.753493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:16.753493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:16.753493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:16.753493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:16.753493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:16.753493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:16.753493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:16.753493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:16.753493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:16.753493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:16.753493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:16.753493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:08:16.753493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:16.753493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:16.753493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:16.754511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:21.235330 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:21.236840 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:21.239044 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=239 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:08:21.275406 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:21.275754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.276655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:08:21.276655 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:21.276655 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:21.276655 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:21.276655 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:21.276655 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:21.276655 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.276655 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:21.277812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.277812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:21.277812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:21.277812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:21.277812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:21.277812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:21.277812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:21.277812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:21.277812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:21.277812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:21.277812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:21.277812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:21.277812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:21.277812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:08:21.277812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:21.277812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:21.277812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.279296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:21.690203 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:21.691652 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:21.692013 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:21.692309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.693777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:08:21.693777 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:21.693777 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:21.693777 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:21.693777 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:21.693777 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:21.693777 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.693777 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:21.694776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.694776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:21.694776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:21.694776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:21.694776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:21.694776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:21.694776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:21.694776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:21.694776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:21.694776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:21.694776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:21.694776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:21.694776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:21.694776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:08:21.694776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:21.694776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.695573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:21.696970 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:21.696970 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:08:21.697403 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:21.697651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.698424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:21.698424 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:21.698424 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:21.698424 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:21.698424 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:21.698424 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:21.698424 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.698424 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:21.699066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.699066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:21.699066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:21.699066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:21.699066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:21.699066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:21.699066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:21.699066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:21.699066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:21.699066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:21.699066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:21.699066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:21.699066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:21.699066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:21.699066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:21.699066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:21.699670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:21.699670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:21.699670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:21.699670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:21.699670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:21.699670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:21.699670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.699670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:21.699961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.699961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:21.699961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:21.699961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:21.699961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:21.699961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:21.699961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:21.699961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:21.699961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:21.699961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:21.699961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:21.699961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:21.699961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:21.699961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:08:21.699961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:08:21.699961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:21.700527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:21.701115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:21.701115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.701115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:21.701570 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:21.701837 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:21.702340 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:21.702719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.703425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:21.703425 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:21.703425 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:21.703425 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:21.703425 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:21.703425 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:21.703425 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.703425 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:21.704214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.704214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:21.704214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:21.704214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:21.704214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:21.704214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:21.704214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:21.704214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:21.704214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:21.704214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:21.704214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:21.704214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:21.704214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:21.704214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:21.704214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:21.704214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:21.704687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:21.704687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:21.704687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:21.704687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:21.704687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:21.704687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:21.704687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.704687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:21.705315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.705315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:21.705315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:21.705315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:21.705315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:21.705315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:21.705315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:21.705315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:21.705315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:21.705315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:21.705315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:21.705315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:21.705315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:21.705315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:08:21.705315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:08:21.705315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:21.705843 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:21.706560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.706560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:21.749220 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:21.750019 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:21.750594 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:21.750913 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:21.751109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.751846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:21.751846 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:21.751846 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:21.751846 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:21.751846 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:21.751846 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:21.751846 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.751846 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:21.753478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.753478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:21.753478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:21.753478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:21.753478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:21.753478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:21.753478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:21.753478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:21.753478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:21.753478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:21.753478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:21.753478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:21.753478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:21.753478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:08:21.753478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:21.753478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:21.753478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:21.754561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:26.236012 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:26.237755 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:26.273578 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:26.273762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.274322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:08:26.274322 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:26.274322 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:26.274322 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:26.274322 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:26.274322 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:26.274322 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.274322 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:26.275378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.275378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:26.275378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:26.275378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:26.275378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:26.275378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:26.275378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:26.275378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:26.275378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:26.275378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:26.275378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:26.275378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:26.275378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:26.275378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:08:26.275378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:26.275378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:26.275378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.276381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:26.691100 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:26.692515 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:26.693169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:26.693169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.694068 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:08:26.694068 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:26.694068 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:26.694068 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:26.694068 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:26.694068 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:26.694068 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.694068 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:26.695712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.695712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:26.695712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:26.695712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:26.695712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:26.695712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:26.695712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:26.695712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:26.695712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:26.695712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:26.695712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:26.695712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:26.695712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:26.695712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:08:26.695712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:26.695712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.696277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:26.696911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:26.697427 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:08:26.697895 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:26.698240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.698909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:26.698909 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:26.698909 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:26.698909 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:26.698909 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:26.698909 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:26.698909 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.698909 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:26.699755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.699755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:26.699755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:26.699755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:26.699755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:26.699755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:26.699755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:26.699755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:26.699755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:26.699755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:26.699755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:26.699755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:26.699755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:26.699755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:26.699755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:26.699755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:26.700535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:26.700535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:26.700535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:26.700535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:26.700535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:26.700535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:26.700535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.700535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:26.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:26.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:26.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:26.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:26.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:26.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:26.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:26.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:26.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:26.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:26.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:26.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:26.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:08:26.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:08:26.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:26.701251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:26.701938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:26.701938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.701938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:26.701938 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:26.702459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:26.702783 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:26.703006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.703545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:26.703545 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:26.703545 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:26.703545 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:26.703545 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:26.703545 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:26.703545 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.703545 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:26.705093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.705093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:26.705093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:26.705093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:26.705093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:26.705093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:26.705093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:26.705093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:26.705093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:26.705093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:26.705093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:26.705093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:26.705093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:26.705093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:26.705093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:26.705093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:26.705713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:26.705713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:26.705713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:26.705713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:26.705713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:26.705713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:26.705713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.705713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:26.706852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.706852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:26.706852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:26.706852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:26.706852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:26.706852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:26.706852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:26.706852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:26.706852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:26.706852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:26.706852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:26.706852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:26.706852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:26.706852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:08:26.706852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:08:26.706852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:26.707550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:26.708283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.708283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:26.750035 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:26.750453 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:26.750897 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:26.751329 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:26.751574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.752276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:26.752276 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:26.752276 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:26.752276 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:26.752276 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:26.752276 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:26.752276 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.752276 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:26.753260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.753260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:26.753260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:26.753260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:26.753260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:26.753260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:26.753260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:26.753260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:26.753260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:26.753260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:26.753260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:26.753260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:26.753260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:26.753260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:08:26.753260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:26.753260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:26.753260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:26.754378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:31.236802 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:31.238391 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:31.270932 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:31.271148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.271716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:08:31.271716 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:31.271716 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:31.271716 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:31.271716 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:31.271716 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:31.271716 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.271716 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:31.272752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.272752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:31.272752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:31.272752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:31.272752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:31.272752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:31.272752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:31.272752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:31.272752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:31.272752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:31.272752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:31.272752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:31.272752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:31.272752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:08:31.272752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:31.272752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:31.272752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.273785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:31.691728 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:31.693186 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:31.694094 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:31.694094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.694874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:08:31.694874 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:31.694874 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:31.694874 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:31.694874 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:31.694874 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:31.694874 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.694874 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:31.696681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.696681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:31.696681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:31.696681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:31.696681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:31.696681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:31.696681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:31.696681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:31.696681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:31.696681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:31.696681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:31.696681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:31.696681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:31.696681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:08:31.696681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:31.696681 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.697440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:31.698245 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:31.698245 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:08:31.698539 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:31.698865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.699781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:31.699781 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:31.699781 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:31.699781 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:31.699781 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:31.699781 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:31.699781 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.699781 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:31.701216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.701216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:31.701216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:31.701216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:31.701216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:31.701216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:31.701216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:31.701216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:31.701216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:31.701216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:31.701216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:31.701216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:31.701216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:31.701216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:31.701216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:31.701216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:31.701727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:31.701727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:31.701727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:31.701727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:31.701727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:31.701727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:31.701727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.701727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:31.703572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.703572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:31.703572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:31.703572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:31.703572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:31.703572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:31.703572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:31.703572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:31.703572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:31.703572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:31.703572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:31.703572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:31.703572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:31.703572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:08:31.703572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:08:31.703572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:31.704012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:31.704559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:31.704559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.704559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:31.704559 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:31.704935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:31.705811 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:31.706173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.706828 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:31.706828 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:31.706828 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:31.706828 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:31.706828 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:31.706828 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:31.706828 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.706828 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:31.707608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.707608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:31.707608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:31.707608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:31.707608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:31.707608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:31.707608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:31.707608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:31.707608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:31.707608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:31.707608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:31.707608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:31.707608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:31.707608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:31.707608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:31.707608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:31.708097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:31.708097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:31.708097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:31.708097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:31.708097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:31.708097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:31.708097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.708097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:31.708753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.708753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:31.708753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:31.708753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:31.708753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:31.708753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:31.708753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:31.708753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:31.708753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:31.708753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:31.708753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:31.708753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:31.708753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:31.708753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:08:31.708753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:08:31.708753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:31.709299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:31.709811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.709811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:31.750616 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:31.751566 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:31.752599 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:31.753036 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:31.753280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.754205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:31.754205 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:31.754205 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:31.754205 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:31.754205 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:31.754205 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:31.754205 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.754205 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:31.756737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.756737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:31.756737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:31.756737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:31.756737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:31.756737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:31.756737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:31.756737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:31.756737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:31.756737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:31.756737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:31.756737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:31.756737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:31.756737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:08:31.756737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:31.756737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:31.756737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:31.757130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:36.237729 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:36.240137 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:36.278236 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:36.278855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.280019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:08:36.280019 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:36.280019 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:36.280019 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:36.280019 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:36.280019 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:36.280019 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.280019 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:36.281153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.281153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:36.281153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:36.281153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:36.281153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:36.281153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:36.281153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:36.281153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:36.281153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:36.281153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:36.281153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:36.281153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:36.281153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:36.281153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:08:36.281153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:36.281153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:36.281153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.282203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:36.692466 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:36.694078 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:36.694414 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:36.694671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.695720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:08:36.695720 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:36.695720 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:36.695720 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:36.695720 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:36.695720 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:36.695720 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.695720 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:36.697809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.697809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:36.697809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:36.697809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:36.697809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:36.697809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:36.697809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:36.697809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:36.697809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:36.697809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:36.697809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:36.697809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:36.697809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:36.697809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:08:36.697809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:36.697809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.698604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:36.699616 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:36.699616 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:08:36.699616 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:36.700006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.700810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:36.700810 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:36.700810 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:36.700810 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:36.700810 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:36.700810 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:36.700810 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.700810 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:36.702245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.702245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:36.702245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:36.702245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:36.702245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:36.702245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:36.702245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:36.702245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:36.702245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:36.702245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:36.702245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:36.702245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:36.702245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:36.702245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:36.702245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:36.702245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:36.703158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:36.703158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:36.703158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:36.703158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:36.703158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:36.703158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:36.703158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.703158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:36.703770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.703770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:36.703770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:36.703770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:36.703770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:36.703770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:36.703770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:36.703770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:36.703770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:36.703770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:36.703770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:36.703770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:36.703770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:36.703770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:08:36.703770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:08:36.703770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:36.704526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:36.705368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:36.705368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.705368 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:36.705368 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:36.705368 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:36.705368 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:36.705686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.706380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:36.706380 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:36.706380 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:36.706380 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:36.706380 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:36.706380 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:36.706380 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.706380 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:36.707675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.707675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:36.707675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:36.707675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:36.707675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:36.707675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:36.707675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:36.707675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:36.707675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:36.707675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:36.707675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:36.707675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:36.707675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:36.707675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:36.707675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:36.707675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:36.708413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:36.708413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:36.708413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:36.708413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:36.708413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:36.708413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:36.708413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.708413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:36.709270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.709270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:36.709270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:36.709270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:36.709270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:36.709270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:36.709270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:36.709270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:36.709270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:36.709270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:36.709270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:36.709270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:36.709270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:36.709270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:08:36.709270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:08:36.709270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:36.709804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:36.710314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.710314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:36.751375 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:36.751805 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:36.752146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:36.752344 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:36.752504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.753102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:36.753102 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:36.753102 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:36.753102 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:36.753102 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:36.753102 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:36.753102 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.753102 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:36.754870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.754870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:36.754870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:36.754870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:36.754870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:36.754870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:36.754870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:36.754870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:36.754870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:36.754870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:36.754870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:36.754870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:36.754870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:36.754870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:08:36.754870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:36.754870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:36.754870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:36.755737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:41.238698 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:41.239712 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:41.274966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:41.275671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.276085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:08:41.276085 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:41.276085 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:41.276085 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:41.276085 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:41.276085 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:41.276085 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.276085 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:41.277311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.277311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:41.277311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:41.277311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:41.277311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:41.277311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:41.277311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:41.277311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:41.277311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:41.277311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:41.277311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:41.277311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:41.277311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:41.277311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:08:41.277311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:41.277311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:41.277311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.278555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:41.693166 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:41.694562 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:41.694916 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:41.695273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.696266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:08:41.696266 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:41.696266 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:41.696266 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:41.696266 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:41.696266 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:41.696266 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.696266 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:41.698102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.698102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:41.698102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:41.698102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:41.698102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:41.698102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:41.698102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:41.698102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:41.698102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:41.698102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:41.698102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:41.698102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:41.698102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:41.698102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:08:41.698102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:41.698102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.698854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:41.699750 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:41.699750 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:08:41.699964 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:41.700294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.701013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:41.701013 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:41.701013 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:41.701013 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:41.701013 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:41.701013 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:41.701013 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.701013 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:41.702385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.702385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:41.702385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:41.702385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:41.702385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:41.702385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:41.702385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:41.702385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:41.702385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:41.702385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:41.702385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:41.702385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:41.702385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:41.702385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:41.702385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:41.702385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:41.703165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:41.703165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:41.703165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:41.703165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:41.703165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:41.703165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:41.703165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.703165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:41.704076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.704076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:41.704076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:41.704076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:41.704076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:41.704076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:41.704076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:41.704076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:41.704076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:41.704076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:41.704076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:41.704076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:41.704076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:41.704076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:08:41.704076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:08:41.704076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:41.704543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:41.705055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:41.705055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.705055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:41.705055 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:41.705456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:41.705819 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:41.706194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.707009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:41.707009 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:41.707009 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:41.707009 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:41.707009 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:41.707009 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:41.707009 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.707009 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:41.708838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.708838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:41.708838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:41.708838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:41.708838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:41.708838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:41.708838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:41.708838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:41.708838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:41.708838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:41.708838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:41.708838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:41.708838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:41.708838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:41.708838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:41.708838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:41.709788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:41.709788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:41.709788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:41.709788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:41.709788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:41.709788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:41.709788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.709788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:41.710626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.710626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:41.710626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:41.710626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:41.710626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:41.710626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:41.710626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:41.710626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:41.710626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:41.710626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:41.710626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:41.710626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:41.710626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:41.710626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:08:41.710626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:08:41.710626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:41.711626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:41.712464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.712464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:41.751905 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:41.752508 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:41.753624 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:41.754096 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:41.754352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.755408 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:41.755408 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:41.755408 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:41.755408 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:41.755408 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:41.755408 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:41.755408 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.755408 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:41.757396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.757396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:41.757396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:41.757396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:41.757396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:41.757396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:41.757396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:41.757396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:41.757396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:41.757396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:41.757396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:41.757396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:41.757396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:41.757396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:08:41.757396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:41.757396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:41.757396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:41.758426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:46.239456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:46.241057 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:46.277549 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:46.277938 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.278942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:08:46.278942 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:46.278942 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:46.278942 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:46.278942 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:46.278942 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:46.278942 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.278942 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:46.280689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.280689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:46.280689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:46.280689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:46.280689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:46.280689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:46.280689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:46.280689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:46.280689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:46.280689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:46.280689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:46.280689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:46.280689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:46.280689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:08:46.280689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:46.280689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:46.280689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.281375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:46.694080 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:46.696080 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:46.696555 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:46.696801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.698279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:08:46.698279 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:46.698279 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:46.698279 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:46.698279 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:46.698279 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:46.698279 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.698279 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:46.700246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.700246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:46.700246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:46.700246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:46.700246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:46.700246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:46.700246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:46.700246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:46.700246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:46.700246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:46.700246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:46.700246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:46.700246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:46.700246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:08:46.700246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:46.700246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.700777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:46.701305 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:46.701305 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:08:46.701533 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:46.701815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.702402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:46.702402 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:46.702402 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:46.702402 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:46.702402 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:46.702402 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:46.702402 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.702402 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:46.703274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.703274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:46.703274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:46.703274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:46.703274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:46.703274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:46.703274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:46.703274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:46.703274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:46.703274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:46.703274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:46.703274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:46.703274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:46.703274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:46.703274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:46.703274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:46.703845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:46.703845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:46.703845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:46.703845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:46.703845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:46.703845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:46.703845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.703845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:46.704284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.704284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:46.704284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:46.704284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:46.704284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:46.704284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:46.704284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:46.704284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:46.704284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:46.704284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:46.704284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:46.704284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:46.704284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:46.704284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:08:46.704284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:08:46.704284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:46.704793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:46.705388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:46.705388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.705388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:46.705388 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:46.705695 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:46.706077 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:46.706314 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.706796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:46.706796 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:46.706796 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:46.706796 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:46.706796 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:46.706796 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:46.706796 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.706796 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:46.707578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.707578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:46.707578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:46.707578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:46.707578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:46.707578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:46.707578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:46.707578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:46.707578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:46.707578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:46.707578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:46.707578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:46.707578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:46.707578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:46.707578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:46.707578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:46.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:46.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:46.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:46.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:46.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:46.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:46.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:46.708693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.708693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:46.708693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:46.708693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:46.708693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:46.708693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:46.708693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:46.708693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:46.708693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:46.708693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:46.708693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:46.708693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:46.708693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:46.708693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:08:46.708693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:08:46.708693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:46.709381 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:46.710141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.710141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:46.752758 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:46.752961 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:46.753943 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:46.754619 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:46.754619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.755486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:46.755486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:46.755486 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:46.755486 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:46.755486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:46.755486 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:46.755486 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.755486 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:46.758184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.758184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:46.758184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:46.758184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:46.758184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:46.758184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:46.758184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:46.758184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:46.758184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:46.758184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:46.758184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:46.758184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:46.758184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:46.758184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:08:46.758184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:46.758184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:46.758184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:46.759019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:51.239937 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:51.241618 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:51.274380 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:51.274820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.275764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:08:51.275764 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:51.275764 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:51.275764 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:51.275764 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:51.275764 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:51.275764 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.275764 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:51.276864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.276864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:51.276864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:51.276864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:51.276864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:51.276864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:51.276864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:51.276864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:51.276864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:51.276864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:51.276864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:51.276864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:51.276864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:51.276864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:08:51.276864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:51.276864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:51.276864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.277796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:51.694859 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:51.696464 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:51.696809 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:51.697101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.698072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:08:51.698072 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:51.698072 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:51.698072 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:51.698072 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:51.698072 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:51.698072 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.698072 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:51.699921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.699921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:51.699921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:51.699921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:51.699921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:51.699921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:51.699921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:51.699921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:51.699921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:51.699921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:51.699921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:51.699921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:51.699921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:51.699921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:08:51.699921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:51.699921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.700647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:51.701362 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:51.701362 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:08:51.702060 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:51.702558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.703020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:51.703020 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:51.703020 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:51.703020 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:51.703020 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:51.703020 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:51.703020 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.703020 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:51.704967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.704967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:51.704967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:51.704967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:51.704967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:51.704967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:51.704967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:51.704967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:51.704967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:51.704967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:51.704967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:51.704967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:51.704967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:51.704967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:51.704967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:51.704967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:51.705648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:51.705648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:51.705648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:51.705648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:51.705648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:51.705648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:51.705648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.705648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:51.706787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.706787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:51.706787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:51.706787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:51.706787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:51.706787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:51.706787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:51.706787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:51.706787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:51.706787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:51.706787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:51.706787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:51.706787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:51.706787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:08:51.706787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:08:51.706787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:51.707293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:51.707835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:51.707835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.707835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:51.707835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:51.707835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:51.707835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:51.708172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.708486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:51.708486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:51.708486 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:51.708486 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:51.708486 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:51.708486 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:51.708486 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.708486 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:51.709233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.709233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:51.709233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:51.709233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:51.709233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:51.709233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:51.709233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:51.709233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:51.709233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:51.709233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:51.709233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:51.709233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:51.709233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:51.709233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:51.709233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:51.709233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:51.709651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:51.709651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:51.709651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:51.709651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:51.709651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:51.709651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:51.709651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.709651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:51.710338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.710338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:51.710338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:51.710338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:51.710338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:51.710338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:51.710338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:51.710338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:51.710338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:51.710338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:51.710338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:51.710338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:51.710338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:51.710338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:08:51.710338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:08:51.710338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:51.710752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:51.711255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.711255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:51.753116 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:51.753640 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:51.754325 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:51.754725 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:51.755002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.755875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:51.755875 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:51.755875 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:51.755875 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:51.755875 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:51.755875 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:51.755875 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.755875 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:51.757687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.757687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:51.757687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:51.757687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:51.757687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:51.757687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:51.757687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:51.757687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:51.757687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:51.757687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:51.757687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:51.757687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:51.757687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:51.757687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:08:51.757687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:51.757687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:51.757687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:51.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:56.240532 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:56.242283 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:56.273837 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:56.274145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.274957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:08:56.274957 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:56.274957 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:56.274957 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:56.274957 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:56.274957 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:56.274957 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.274957 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:56.276917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.276917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:56.276917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:56.276917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:56.276917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:56.276917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:56.276917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:56.276917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:56.276917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:56.276917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:56.276917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:56.276917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:56.276917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:56.276917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:08:56.276917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:56.276917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:56.276917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.278175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:56.695721 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:56.696892 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:56.697285 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:56.697542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.698422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:56.698422 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:56.698422 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:56.698422 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:56.698422 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:56.698422 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:56.698422 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.698422 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:56.699580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.699580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:56.699580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:56.699580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:56.699580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:56.699580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:56.699580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:56.699580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:56.699580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:56.699580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:56.699580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:56.699580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:56.699580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:56.699580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:08:56.699580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:56.699580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:56.699580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.700448 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:56.701531 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:56.702197 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:08:56.702780 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:56.703168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.704003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:56.704003 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:56.704003 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:56.704003 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:56.704003 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:56.704003 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:56.704003 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.704003 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:56.705276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.705276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:56.705276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:56.705276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:56.705276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:56.705276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:56.705276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:56.705276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:56.705276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:56.705276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:56.705276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:56.705276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:56.705276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:56.705276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:56.705276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:56.705276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:56.705799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:56.705799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:56.705799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:56.705799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:56.705799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:56.705799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:56.705799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.705799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:56.706899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.706899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:56.706899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:56.706899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:56.706899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:56.706899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:56.706899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:56.706899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:56.706899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:56.706899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:56.706899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:56.706899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:56.706899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:56.706899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:08:56.706899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:08:56.706899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:56.707492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:56.708060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:56.708060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.708060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:56.708060 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:56.708060 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:56.708355 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:56.708716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.709530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:08:56.709530 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:56.709530 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:56.709530 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:56.709530 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:56.709530 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:56.709530 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.709530 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:56.711129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.711129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:08:56.711129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:56.711129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:56.711129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:56.711129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:56.711129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:56.711129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:56.711129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:56.711129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:08:56.711129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:56.711129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:08:56.711129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:56.711129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:08:56.711129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:08:56.711584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:56.711584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:08:56.711584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:56.711584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:08:56.711584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:08:56.711584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:56.711584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:08:56.711584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.711584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:08:56.712421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.712421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:56.712421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:56.712421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:56.712421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:56.712421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:56.712421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:56.712421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:56.712421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:56.712421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:56.712421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:56.712421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:56.712421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:56.712421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:08:56.712421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:08:56.712421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:56.712888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:56.713374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.713374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:08:56.753587 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:08:56.754168 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:08:56.754722 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:56.755224 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:08:56.755534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.756429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:08:56.756429 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:56.756429 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:08:56.756429 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:08:56.756429 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:56.756429 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:08:56.756429 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.756429 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:08:56.757977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.757977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:08:56.757977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:08:56.757977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:08:56.757977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:08:56.757977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:08:56.757977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:56.757977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:08:56.757977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:08:56.757977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:08:56.757977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:08:56.757977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:08:56.757977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:08:56.757977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:08:56.757977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:08:56.757977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:56.757977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:08:56.759070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:01.241339 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:01.242782 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:01.277242 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:01.277616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.278497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:09:01.278497 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:01.278497 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:01.278497 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:01.278497 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:01.278497 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:01.278497 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.278497 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:01.279395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.279395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:01.279395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:01.279395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:01.279395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:01.279395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:01.279395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:01.279395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:01.279395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:01.279395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:01.279395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:01.279395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:01.279395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:01.279395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:09:01.279395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:01.279395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:01.279395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.280466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:01.696604 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:01.697911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:01.698110 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:01.698268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.698888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:01.698888 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:01.698888 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:01.698888 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:01.698888 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:01.698888 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:01.698888 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.698888 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:01.700658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.700658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:01.700658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:01.700658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:01.700658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:01.700658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:01.700658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:01.700658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:01.700658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:01.700658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:01.700658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:01.700658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:01.700658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:01.700658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:09:01.700658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:01.700658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:01.700658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.701030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:01.702044 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:01.702601 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:09:01.703019 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:01.703184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.703695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:01.703695 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:01.703695 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:01.703695 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:01.703695 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:01.703695 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:01.703695 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.703695 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:01.705162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.705162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:01.705162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:01.705162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:01.705162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:01.705162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:01.705162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:01.705162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:01.705162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:01.705162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:01.705162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:01.705162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:01.705162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:01.705162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:01.705162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:01.705162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:01.705515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:01.705515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:01.705515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:01.705515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:01.705515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:01.705515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:01.705515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.705515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:01.706904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.706904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:01.706904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:01.706904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:01.706904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:01.706904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:01.706904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:01.706904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:01.706904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:01.706904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:01.706904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:01.706904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:01.706904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:01.706904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:09:01.706904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:09:01.706904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:01.707243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:01.707595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:01.707595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.707595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:01.707733 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:01.708371 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:01.709209 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:01.709209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.709346 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:09:01.709346 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:01.709346 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:01.709346 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:01.709346 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:01.709346 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:01.709346 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.709346 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:01.709971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.709971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:01.709971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:01.709971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:01.709971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:01.709971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:01.709971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:01.709971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:01.709971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:01.709971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:01.709971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:01.709971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:01.709971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:01.709971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:01.709971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:01.710664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:01.710664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:01.710664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:01.710664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:01.710664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:01.710664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:01.710664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:01.710664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.710664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:01.711144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.711144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:01.711144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:01.711144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:01.711144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:01.711144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:01.711144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:01.711144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:01.711144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:01.711144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:01.711144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:01.711144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:01.711144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:01.711144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:09:01.711144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:09:01.711144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:01.711860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:01.712753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.712753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:01.754308 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:01.754854 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:01.755517 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:01.755916 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:01.756134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.756837 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:01.756837 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:01.756837 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:01.756837 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:01.756837 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:01.756837 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:01.756837 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.756837 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:01.758207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.758207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:01.758207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:01.758207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:01.758207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:01.758207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:01.758207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:01.758207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:01.758207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:01.758207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:01.758207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:01.758207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:01.758207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:01.758207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:09:01.758207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:01.758207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:01.758207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:01.758838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:06.242308 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:06.244696 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:06.286732 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:06.287194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.288385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:09:06.288385 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:06.288385 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:06.288385 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:06.288385 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:06.288385 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:06.288385 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.288385 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:06.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:06.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:06.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:06.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:06.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:06.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:06.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:06.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:06.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:06.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:06.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:06.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:06.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:09:06.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:06.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:06.289747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.290785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:06.697549 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:06.699056 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:06.699418 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:06.699661 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.700477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:06.700477 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:06.700477 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:06.700477 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:06.700477 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:06.700477 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:06.700477 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.700477 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:06.702216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.702216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:06.702216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:06.702216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:06.702216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:06.702216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:06.702216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:06.702216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:06.702216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:06.702216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:06.702216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:06.702216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:06.702216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:06.702216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:09:06.702216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:06.702216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:06.702216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.702739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:06.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:06.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:09:06.703337 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:06.703684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.704456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:06.704456 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:06.704456 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:06.704456 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:06.704456 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:06.704456 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:06.704456 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.704456 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:06.705742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.705742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:06.705742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:06.705742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:06.705742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:06.705742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:06.705742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:06.705742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:06.705742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:06.705742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:06.705742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:06.705742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:06.705742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:06.705742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:06.705742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:06.705742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:06.706291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:06.706291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:06.706291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:06.706291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:06.706291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:06.706291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:06.706291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.706291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:06.706877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.706877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:06.706877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:06.706877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:06.706877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:06.706877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:06.706877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:06.706877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:06.706877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:06.706877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:06.706877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:06.706877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:06.706877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:06.706877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:09:06.706877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:09:06.706877 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:06.707421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:06.707896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:06.707896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.707896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:06.708242 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:06.708762 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:06.709197 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:06.709418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.709956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:09:06.709956 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:06.709956 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:06.709956 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:06.709956 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:06.709956 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:06.709956 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.709956 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:06.711200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.711200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:06.711200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:06.711200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:06.711200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:06.711200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:06.711200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:06.711200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:06.711200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:06.711200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:06.711200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:06.711200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:06.711200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:06.711200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:06.711200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:06.711644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:06.711644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:06.711644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:06.711644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:06.711644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:06.711644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:06.711644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:06.711644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.711644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:06.712666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.712666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:06.712666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:06.712666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:06.712666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:06.712666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:06.712666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:06.712666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:06.712666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:06.712666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:06.712666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:06.712666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:06.712666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:06.712666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:09:06.712666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:09:06.712666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:06.713135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:06.713613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.713613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:06.754888 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:06.755548 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:06.756267 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:06.756710 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:06.757025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:06.758191 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:06.758191 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:06.758191 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:06.758191 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:06.758191 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:06.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.758191 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:06.759940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.759940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:06.759940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:06.759940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:06.759940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:06.759940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:06.759940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:06.759940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:06.759940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:06.759940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:06.759940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:06.759940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:06.759940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:06.759940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:09:06.759940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:06.759940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:06.759940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:06.760767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:11.285316 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:11.286765 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:11.314872 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:11.315154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.315968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:09:11.315968 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:11.315968 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:11.315968 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:11.315968 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:11.315968 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:11.315968 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.315968 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:11.316898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.316898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:11.316898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:11.316898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:11.316898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:11.316898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:11.316898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:11.316898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:11.316898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:11.316898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:11.316898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:11.316898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:11.316898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:11.316898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:09:11.316898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:11.316898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:11.316898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.317852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:11.698457 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:11.699860 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:11.700274 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:11.700626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.701504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:11.701504 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:11.701504 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:11.701504 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:11.701504 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:11.701504 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:11.701504 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.701504 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:11.702799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.702799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:11.702799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:11.702799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:11.702799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:11.702799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:11.702799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:11.702799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:11.702799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:11.702799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:11.702799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:11.702799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:11.702799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:11.702799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:09:11.702799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:11.702799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:11.702799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.703847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:11.704788 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:11.704788 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:09:11.704788 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:11.704788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.705221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:11.705221 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:11.705221 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:11.705221 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:11.705221 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:11.705221 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:11.705221 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.705221 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:11.706506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.706506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:11.706506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:11.706506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:11.706506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:11.706506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:11.706506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:11.706506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:11.706506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:11.706506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:11.706506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:11.706506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:11.706506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:11.706506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:11.706506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:11.706506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:11.707420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:11.707420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:11.707420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:11.707420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:11.707420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:11.707420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:11.707420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.707420 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:11.708127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.708127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:11.708127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:11.708127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:11.708127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:11.708127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:11.708127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:11.708127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:11.708127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:11.708127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:11.708127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:11.708127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:11.708127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:11.708127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:09:11.708127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:09:11.708127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:11.708874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:11.709779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:11.709779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.709779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:11.709779 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:11.709779 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:11.709779 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:11.709779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.710276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:09:11.710276 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:11.710276 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:11.710276 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:11.710276 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:11.710276 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:11.710276 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.710276 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:11.711038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.711038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:11.711038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:11.711038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:11.711038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:11.711038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:11.711038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:11.711038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:11.711038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:11.711038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:11.711038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:11.711038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:11.711038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:11.711038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:11.711038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:11.712265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:11.712265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:11.712265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:11.712265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:11.712265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:11.712265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:11.712265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:11.712265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.712265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:11.712580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.712580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:11.712580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:11.712580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:11.712580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:11.712580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:11.712580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:11.712580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:11.712580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:11.712580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:11.712580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:11.712580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:11.712580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:11.712580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:09:11.712580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:09:11.712580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:11.713055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:11.713546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.713546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:11.755709 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:11.755974 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:11.756748 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:11.757213 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:11.757449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.758480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:11.758480 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:11.758480 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:11.758480 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:11.758480 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:11.758480 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:11.758480 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.758480 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:11.759646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.759646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:11.759646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:11.759646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:11.759646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:11.759646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:11.759646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:11.759646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:11.759646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:11.759646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:11.759646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:11.759646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:11.759646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:11.759646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:09:11.759646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:11.759646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:11.759646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:11.760351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:16.285375 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:16.286832 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:16.322009 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:16.322393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.323090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:09:16.323090 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:16.323090 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:16.323090 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:16.323090 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:16.323090 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:16.323090 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.323090 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:16.323860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.323860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:16.323860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:16.323860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:16.323860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:16.323860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:16.323860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:16.323860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:16.323860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:16.323860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:16.323860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:16.323860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:16.323860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:16.323860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:09:16.323860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:16.323860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:16.323860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.324618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:16.699195 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:16.700412 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:16.700752 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:16.701056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.701894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:16.701894 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:16.701894 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:16.701894 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:16.701894 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:16.701894 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:16.701894 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.701894 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:16.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:16.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:16.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:16.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:16.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:16.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:16.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:16.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:16.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:16.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:16.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:16.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:16.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:09:16.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:16.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:16.703255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.704154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:16.705201 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:16.705201 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:09:16.705201 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:16.705429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.705869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:16.705869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:16.705869 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:16.705869 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:16.705869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:16.705869 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:16.705869 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.705869 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:16.706595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.706595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:16.706595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:16.706595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:16.706595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:16.706595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:16.706595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:16.706595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:16.706595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:16.706595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:16.706595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:16.706595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:16.706595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:16.706595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:16.706595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:16.706595 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:16.707218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:16.707218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:16.707218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:16.707218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:16.707218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:16.707218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:16.707218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.707218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:16.707741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.707741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:16.707741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:16.707741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:16.707741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:16.707741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:16.707741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:16.707741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:16.707741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:16.707741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:16.707741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:16.707741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:16.707741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:16.707741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:09:16.707741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:09:16.707741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:16.708222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:16.708711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:16.708711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.708711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:16.709428 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:16.710408 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:16.710839 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:16.711089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.711766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:09:16.711766 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:16.711766 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:16.711766 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:16.711766 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:16.711766 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:16.711766 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.711766 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:16.713146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.713146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:16.713146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:16.713146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:16.713146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:16.713146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:16.713146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:16.713146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:16.713146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:16.713146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:16.713146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:16.713146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:16.713146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:16.713146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:16.713146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:16.713639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:16.713639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:16.713639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:16.713639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:16.713639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:16.713639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:16.713639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:16.713639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.713639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:16.715178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.715178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:16.715178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:16.715178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:16.715178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:16.715178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:16.715178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:16.715178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:16.715178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:16.715178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:16.715178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:16.715178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:16.715178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:16.715178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:09:16.715178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:09:16.715178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:16.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:16.716301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.716301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:16.756243 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:16.756634 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:16.757278 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:16.757789 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:16.758025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.759067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:16.759067 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:16.759067 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:16.759067 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:16.759067 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:16.759067 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:16.759067 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.759067 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:16.760717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.760717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:16.760717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:16.760717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:16.760717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:16.760717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:16.760717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:16.760717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:16.760717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:16.760717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:16.760717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:16.760717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:16.760717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:16.760717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:09:16.760717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:16.760717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:16.760717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:16.761264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:21.286160 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:21.287903 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:21.352937 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=240 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:09:21.387567 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:21.387846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.388653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Traceback (most recent call last):
Apr 07 20:09:21.388653 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:21.388653 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:21.388653 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:21.388653 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:21.388653 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:21.388653 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.388653 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:21.390188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-ee2306de-c6e2-478e-b5c4-947e7d9f960e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.390188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:21.390188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:21.390188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:21.390188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:21.390188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:21.390188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:21.390188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:21.390188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:21.390188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:21.390188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:21.390188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:21.390188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:21.390188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:09:21.390188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:21.390188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:21.390188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.391116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:21.700022 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:21.701319 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:21.701682 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:21.701937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.702878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:21.702878 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:21.702878 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:21.702878 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:21.702878 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:21.702878 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:21.702878 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.702878 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:21.704086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.704086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:21.704086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:21.704086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:21.704086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:21.704086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:21.704086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:21.704086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:21.704086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:21.704086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:21.704086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:21.704086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:21.704086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:21.704086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:09:21.704086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:21.704086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:21.704086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.704650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:21.705475 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:21.705475 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:09:21.705553 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:21.705835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.706473 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:21.706473 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:21.706473 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:21.706473 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:21.706473 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:21.706473 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:21.706473 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.706473 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:21.707551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.707551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:21.707551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:21.707551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:21.707551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:21.707551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:21.707551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:21.707551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:21.707551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:21.707551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:21.707551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:21.707551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:21.707551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:21.707551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:21.707551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:21.707551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:21.708355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:21.708355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:21.708355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:21.708355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:21.708355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:21.708355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:21.708355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.708355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:21.708929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.708929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:21.708929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:21.708929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:21.708929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:21.708929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:21.708929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:21.708929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:21.708929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:21.708929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:21.708929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:21.708929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:21.708929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:21.708929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:09:21.708929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:09:21.708929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:21.709415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:21.709888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:21.709888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.709888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:21.710247 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:21.710715 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:21.711291 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:21.711627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.712430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:09:21.712430 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:21.712430 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:21.712430 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:21.712430 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:21.712430 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:21.712430 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.712430 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:21.713604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.713604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:21.713604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:21.713604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:21.713604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:21.713604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:21.713604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:21.713604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:21.713604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:21.713604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:21.713604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:21.713604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:21.713604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:21.713604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:21.713604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:21.714046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:21.714046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:21.714046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:21.714046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:21.714046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:21.714046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:21.714046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:21.714046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.714046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:21.715280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.715280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:21.715280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:21.715280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:21.715280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:21.715280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:21.715280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:21.715280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:21.715280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:21.715280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:21.715280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:21.715280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:21.715280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:21.715280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:09:21.715280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:09:21.715280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:21.715732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:21.716594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.716594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:21.756853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:21.757523 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:21.758125 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:21.758495 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:21.758748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.759551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:21.759551 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:21.759551 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:21.759551 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:21.759551 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:21.759551 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:21.759551 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.759551 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:21.760770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.760770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:21.760770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:21.760770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:21.760770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:21.760770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:21.760770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:21.760770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:21.760770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:21.760770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:21.760770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:21.760770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:21.760770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:21.760770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:09:21.760770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:21.760770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:21.760770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:21.761385 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:26.286868 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:26.288591 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:26.321203 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:26.321667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.322606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:09:26.322606 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:26.322606 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:26.322606 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:26.322606 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:26.322606 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:26.322606 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.322606 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:26.323777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.323777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:26.323777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:26.323777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:26.323777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:26.323777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:26.323777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:26.323777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:26.323777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:26.323777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:26.323777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:26.323777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:26.323777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:26.323777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:09:26.323777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:26.323777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:26.323777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.324373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:26.701092 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:26.702798 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:26.703239 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:26.703445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.704412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:26.704412 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:26.704412 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:26.704412 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:26.704412 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:26.704412 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:26.704412 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.704412 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:26.706641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.706641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:26.706641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:26.706641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:26.706641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:26.706641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:26.706641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:26.706641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:26.706641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:26.706641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:26.706641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:26.706641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:26.706641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:26.706641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:09:26.706641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:26.706641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:26.706641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.707281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:26.707779 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:26.707779 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:09:26.708215 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:26.708470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.709119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:26.709119 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:26.709119 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:26.709119 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:26.709119 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:26.709119 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:26.709119 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.709119 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:26.710711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.710711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:26.710711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:26.710711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:26.710711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:26.710711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:26.710711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:26.710711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:26.710711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:26.710711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:26.710711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:26.710711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:26.710711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:26.710711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:26.710711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:26.710711 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:26.711454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:26.711454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:26.711454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:26.711454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:26.711454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:26.711454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:26.711454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.711454 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:26.712109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.712109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:26.712109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:26.712109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:26.712109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:26.712109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:26.712109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:26.712109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:26.712109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:26.712109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:26.712109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:26.712109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:26.712109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:26.712109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:09:26.712109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:09:26.712109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:26.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:26.713160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:26.713160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.713160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:26.713160 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:26.713160 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:26.713160 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:26.713395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.713890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:26.713890 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:26.713890 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:26.713890 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:26.713890 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:26.713890 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:26.713890 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.713890 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:26.714868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.714868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:26.714868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:26.714868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:26.714868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:26.714868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:26.714868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:26.714868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:26.714868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:26.714868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:26.714868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:26.714868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:26.714868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:26.714868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:26.714868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:26.714868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:26.715551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:26.715551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:26.715551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:26.715551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:26.715551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:26.715551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:26.715551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.715551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:26.715801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.715801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:26.715801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:26.715801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:26.715801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:26.715801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:26.715801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:26.715801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:26.715801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:26.715801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:26.715801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:26.715801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:26.715801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:26.715801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:09:26.715801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:09:26.715801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:26.716356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:26.717208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.717208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:26.757702 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:26.758277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:26.759325 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:26.759746 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:26.760108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.761059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:26.761059 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:26.761059 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:26.761059 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:26.761059 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:26.761059 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:26.761059 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.761059 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:26.762316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.762316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:26.762316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:26.762316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:26.762316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:26.762316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:26.762316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:26.762316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:26.762316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:26.762316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:26.762316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:26.762316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:26.762316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:26.762316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:09:26.762316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:26.762316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:26.762316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:26.763086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:31.287652 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:31.289362 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:31.325532 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:31.325869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.326895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:09:31.326895 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:31.326895 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:31.326895 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:31.326895 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:31.326895 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:31.326895 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.326895 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:31.328322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.328322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:31.328322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:31.328322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:31.328322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:31.328322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:31.328322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:31.328322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:31.328322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:31.328322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:31.328322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:31.328322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:31.328322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:31.328322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:09:31.328322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:31.328322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:31.328322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.328852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:31.701611 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:31.702910 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:31.703278 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:31.703532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.704462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:31.704462 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:31.704462 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:31.704462 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:31.704462 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:31.704462 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:31.704462 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.704462 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:31.705709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.705709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:31.705709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:31.705709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:31.705709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:31.705709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:31.705709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:31.705709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:31.705709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:31.705709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:31.705709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:31.705709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:31.705709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:31.705709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:09:31.705709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:31.705709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:31.705709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.706588 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:31.707428 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:31.707726 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:09:31.708114 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:31.708308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.708888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:31.708888 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:31.708888 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:31.708888 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:31.708888 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:31.708888 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:31.708888 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.708888 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:31.710393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.710393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:31.710393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:31.710393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:31.710393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:31.710393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:31.710393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:31.710393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:31.710393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:31.710393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:31.710393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:31.710393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:31.710393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:31.710393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:31.710393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:31.710393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:31.711597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:31.711597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:31.711597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:31.711597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:31.711597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:31.711597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:31.711597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.711597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:31.712842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.712842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:31.712842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:31.712842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:31.712842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:31.712842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:31.712842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:31.712842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:31.712842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:31.712842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:31.712842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:31.712842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:31.712842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:31.712842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:09:31.712842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:09:31.712842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:31.713396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:31.713935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:31.713935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.713935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:31.713935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:31.713935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:31.713935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:31.714659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.715210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:09:31.715210 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:31.715210 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:31.715210 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:31.715210 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:31.715210 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:31.715210 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.715210 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:31.716625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.716625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:31.716625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:31.716625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:31.716625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:31.716625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:31.716625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:31.716625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:31.716625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:31.716625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:31.716625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:31.716625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:31.716625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:31.716625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:31.716625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:31.717134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:31.717134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:31.717134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:31.717134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:31.717134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:31.717134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:31.717134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:31.717134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.717134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:31.718735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.718735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:31.718735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:31.718735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:31.718735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:31.718735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:31.718735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:31.718735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:31.718735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:31.718735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:31.718735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:31.718735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:31.718735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:31.718735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:09:31.718735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:09:31.718735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:31.719253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:31.719778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.719778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:31.758312 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:31.758618 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:31.759151 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:31.759409 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:31.759565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.760112 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:31.760112 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:31.760112 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:31.760112 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:31.760112 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:31.760112 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:31.760112 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.760112 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:31.761632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.761632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:31.761632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:31.761632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:31.761632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:31.761632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:31.761632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:31.761632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:31.761632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:31.761632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:31.761632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:31.761632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:31.761632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:31.761632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:09:31.761632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:31.761632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:31.761632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:31.762161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:36.288361 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:36.290087 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:36.321356 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:36.321754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:09:36.322664 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:36.322664 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:36.322664 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:36.322664 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:36.322664 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:36.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.322664 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:36.323611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.323611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:36.323611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:36.323611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:36.323611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:36.323611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:36.323611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:36.323611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:36.323611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:36.323611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:36.323611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:36.323611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:36.323611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:36.323611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:09:36.323611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:36.323611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:36.323611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.324527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:36.702340 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:36.703493 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:36.703828 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:36.704179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.704878 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:36.704878 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:36.704878 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:36.704878 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:36.704878 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:36.704878 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:36.704878 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.704878 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:36.706023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.706023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:36.706023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:36.706023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:36.706023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:36.706023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:36.706023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:36.706023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:36.706023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:36.706023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:36.706023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:36.706023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:36.706023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:36.706023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:09:36.706023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:36.706023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:36.706023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.706521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:36.707796 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:36.708123 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:09:36.708637 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:36.708949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.709639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:36.709639 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:36.709639 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:36.709639 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:36.709639 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:36.709639 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:36.709639 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.709639 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:36.710476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.710476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:36.710476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:36.710476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:36.710476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:36.710476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:36.710476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:36.710476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:36.710476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:36.710476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:36.710476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:36.710476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:36.710476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:36.710476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:36.710476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:36.710476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:36.711171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:36.711171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:36.711171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:36.711171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:36.711171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:36.711171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:36.711171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.711171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:36.711757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.711757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:36.711757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:36.711757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:36.711757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:36.711757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:36.711757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:36.711757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:36.711757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:36.711757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:36.711757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:36.711757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:36.711757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:36.711757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:09:36.711757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:09:36.711757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:36.712410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:36.713086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:36.713086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.713086 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:36.713221 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:36.713802 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:36.714329 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:36.714750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.715533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:09:36.715533 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:36.715533 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:36.715533 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:36.715533 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:36.715533 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:36.715533 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.715533 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:36.716555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.716555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:36.716555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:36.716555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:36.716555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:36.716555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:36.716555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:36.716555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:36.716555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:36.716555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:36.716555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:36.716555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:36.716555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:36.716555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:36.716555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:36.717176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:36.717176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:36.717176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:36.717176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:36.717176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:36.717176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:36.717176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:36.717176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.717176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:36.717763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.717763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:36.717763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:36.717763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:36.717763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:36.717763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:36.717763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:36.717763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:36.717763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:36.717763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:36.717763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:36.717763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:36.717763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:36.717763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:09:36.717763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:09:36.717763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:36.718278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:36.718846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.718846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:36.759170 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:36.759444 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:36.760114 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:36.760507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:36.760750 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.761604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:36.761604 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:36.761604 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:36.761604 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:36.761604 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:36.761604 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:36.761604 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.761604 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:36.763409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.763409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:36.763409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:36.763409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:36.763409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:36.763409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:36.763409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:36.763409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:36.763409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:36.763409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:36.763409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:36.763409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:36.763409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:36.763409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:09:36.763409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:36.763409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:36.763409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:36.764335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:41.289185 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:41.290775 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:41.323233 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:41.323233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.323823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:09:41.323823 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:41.323823 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:41.323823 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:41.323823 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:41.323823 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:41.323823 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.323823 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:41.325110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.325110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:41.325110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:41.325110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:41.325110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:41.325110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:41.325110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:41.325110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:41.325110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:41.325110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:41.325110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:41.325110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:41.325110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:41.325110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:09:41.325110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:41.325110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:41.325110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.326173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:41.703458 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:41.705241 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:41.705559 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:41.705775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.706600 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:41.706600 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:41.706600 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:41.706600 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:41.706600 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:41.706600 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:41.706600 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.706600 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:41.708493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.708493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:41.708493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:41.708493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:41.708493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:41.708493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:41.708493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:41.708493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:41.708493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:41.708493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:41.708493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:41.708493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:41.708493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:41.708493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:09:41.708493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:41.708493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:41.708493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.709057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:41.709568 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:41.709568 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:09:41.709873 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:41.710096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.710655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:41.710655 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:41.710655 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:41.710655 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:41.710655 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:41.710655 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:41.710655 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.710655 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:41.712066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.712066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:41.712066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:41.712066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:41.712066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:41.712066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:41.712066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:41.712066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:41.712066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:41.712066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:41.712066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:41.712066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:41.712066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:41.712066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:41.712066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:41.712066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:41.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:41.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:41.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:41.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:41.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:41.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:41.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.712597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:41.713840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.713840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:41.713840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:41.713840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:41.713840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:41.713840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:41.713840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:41.713840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:41.713840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:41.713840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:41.713840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:41.713840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:41.713840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:41.713840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:09:41.713840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:09:41.713840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:41.714371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:41.714852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:41.714852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.714852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:41.715188 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:41.715698 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:41.716063 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:41.716398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.717650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:09:41.717650 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:41.717650 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:41.717650 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:41.717650 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:41.717650 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:41.717650 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.717650 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:41.718334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.718334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:41.718334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:41.718334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:41.718334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:41.718334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:41.718334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:41.718334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:41.718334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:41.718334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:41.718334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:41.718334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:41.718334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:41.718334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:41.718334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:41.719867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:41.719867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:41.719867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:41.719867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:41.719867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:41.719867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:41.719867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:41.719867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.719867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:41.719867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.719867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:41.719867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:41.719867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:41.719867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:41.719867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:41.720523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:41.721072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:41.721072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:41.721072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:41.721072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:41.721072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:41.721072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:41.721072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:41.721072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:41.721072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:41.721072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:41.721072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.721072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:41.759827 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:41.760683 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:41.761405 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:41.761666 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:41.761824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.762593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:41.762593 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:41.762593 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:41.762593 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:41.762593 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:41.762593 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:41.762593 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.762593 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:41.764646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.764646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:41.764646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:41.764646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:41.764646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:41.764646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:41.764646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:41.764646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:41.764646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:41.764646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:41.764646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:41.764646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:41.764646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:41.764646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:09:41.764646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:41.764646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:41.764646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:41.765526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:46.289877 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:46.291703 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:46.327711 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:46.328183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.329139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:09:46.329139 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:46.329139 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:46.329139 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:46.329139 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:46.329139 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:46.329139 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.329139 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:46.330102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.330102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:46.330102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:46.330102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:46.330102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:46.330102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:46.330102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:46.330102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:46.330102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:46.330102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:46.330102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:46.330102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:46.330102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:46.330102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:09:46.330102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:46.330102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:46.330102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.331131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:46.704235 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:46.705553 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:46.705818 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:46.706082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.707117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:46.707117 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:46.707117 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:46.707117 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:46.707117 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:46.707117 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:46.707117 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.707117 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:46.708904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.708904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:46.708904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:46.708904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:46.708904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:46.708904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:46.708904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:46.708904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:46.708904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:46.708904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:46.708904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:46.708904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:46.708904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:46.708904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:09:46.708904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:46.708904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:46.708904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.709744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:46.710821 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:46.710821 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:09:46.710821 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:46.710821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.711172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:46.711172 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:46.711172 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:46.711172 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:46.711172 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:46.711172 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:46.711172 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.711172 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:46.712333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.712333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:46.712333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:46.712333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:46.712333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:46.712333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:46.712333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:46.712333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:46.712333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:46.712333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:46.712333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:46.712333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:46.712333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:46.712333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:46.712333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:46.712333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:46.713185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:46.713185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:46.713185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:46.713185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:46.713185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:46.713185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:46.713185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.713185 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:46.713911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.713911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:46.713911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:46.713911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:46.713911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:46.713911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:46.713911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:46.713911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:46.713911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:46.713911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:46.713911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:46.713911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:46.713911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:46.713911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:09:46.713911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:09:46.713911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:46.714596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:46.715117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:46.715117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.715117 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:46.715643 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:46.716131 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:46.716484 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:46.716893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.718066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:09:46.718066 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:46.718066 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:46.718066 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:46.718066 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:46.718066 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:46.718066 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.718066 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:46.718654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.718654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:46.718654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:46.718654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:46.718654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:46.718654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:46.718654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:46.718654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:46.718654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:46.718654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:46.718654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:46.718654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:46.718654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:46.718654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:46.718654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:46.719365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:46.719365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:46.719365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:46.719365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:46.719365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:46.719365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:46.719365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:46.719365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.719365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:46.719787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.719787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:46.719787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:46.719787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:46.719787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:46.719787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:46.719787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:46.719787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:46.719787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:46.719787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:46.719787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:46.719787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:46.719787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:46.719787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:09:46.719787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:09:46.719787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:46.720493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:46.721353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.721353 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:46.760476 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:46.760848 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:46.761824 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:46.762213 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:46.762709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.763606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:46.763606 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:46.763606 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:46.763606 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:46.763606 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:46.763606 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:46.763606 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.763606 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:46.765355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.765355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:46.765355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:46.765355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:46.765355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:46.765355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:46.765355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:46.765355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:46.765355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:46.765355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:46.765355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:46.765355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:46.765355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:46.765355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:09:46.765355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:46.765355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:46.765355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:46.766468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:51.290975 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:51.292595 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:51.327281 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:51.327518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.328310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:09:51.328310 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:51.328310 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:51.328310 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:51.328310 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:51.328310 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:51.328310 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.328310 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:51.329477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.329477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:51.329477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:51.329477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:51.329477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:51.329477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:51.329477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:51.329477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:51.329477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:51.329477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:51.329477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:51.329477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:51.329477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:51.329477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:09:51.329477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:51.329477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:51.329477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.330343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:51.704947 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:51.706278 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:51.706642 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:51.706918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.707909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:51.707909 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:51.707909 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:51.707909 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:51.707909 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:51.707909 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:51.707909 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.707909 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:51.710329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.710329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:51.710329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:51.710329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:51.710329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:51.710329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:51.710329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:51.710329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:51.710329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:51.710329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:51.710329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:51.710329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:51.710329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:51.710329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:09:51.710329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:51.710329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:51.710329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.711415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:51.712462 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:51.712462 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:09:51.712462 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:51.712462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.712966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:51.712966 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:51.712966 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:51.712966 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:51.712966 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:51.712966 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:51.712966 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.712966 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:51.714199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.714199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:51.714199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:51.714199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:51.714199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:51.714199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:51.714199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:51.714199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:51.714199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:51.714199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:51.714199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:51.714199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:51.714199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:51.714199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:51.714199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:51.714199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:51.714714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:51.714714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:51.714714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:51.714714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:51.714714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:51.714714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:51.714714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.714714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:51.715753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.715753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:51.715753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:51.715753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:51.715753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:51.715753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:51.715753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:51.715753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:51.715753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:51.715753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:51.715753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:51.715753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:51.715753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:51.715753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:09:51.715753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:09:51.715753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:51.716274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:51.716782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:51.716782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.716782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:51.716782 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:51.716782 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:51.717200 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:51.717423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.718057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:09:51.718057 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:51.718057 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:51.718057 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:51.718057 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:51.718057 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:51.718057 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.718057 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:51.719443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.719443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:51.719443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:51.719443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:51.719443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:51.719443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:51.719443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:51.719443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:51.719443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:51.719443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:51.719443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:51.719443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:51.719443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:51.719443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:51.719443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:51.719875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:51.719875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:51.719875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:51.719875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:51.719875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:51.719875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:51.719875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:51.719875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.719875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:51.721223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.721223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:51.721223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:51.721223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:51.721223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:51.721223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:51.721223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:51.721223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:51.721223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:51.721223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:51.721223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:51.721223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:51.721223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:51.721223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:09:51.721223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:09:51.721223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:51.721689 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:51.722288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.722288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:51.761126 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:51.761628 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:51.762154 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:51.762416 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:51.762577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.763213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:51.763213 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:51.763213 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:51.763213 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:51.763213 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:51.763213 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:51.763213 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.763213 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:51.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:51.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:51.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:51.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:51.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:51.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:51.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:51.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:51.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:51.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:51.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:51.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:51.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:09:51.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:51.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:51.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:51.765822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:56.291836 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:56.293575 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:56.330092 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:56.330483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.331394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:09:56.331394 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:56.331394 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:56.331394 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:56.331394 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:56.331394 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:56.331394 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.331394 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:56.332655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.332655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:56.332655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:56.332655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:56.332655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:56.332655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:56.332655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:56.332655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:56.332655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:56.332655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:56.332655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:56.332655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:56.332655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:56.332655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:09:56.332655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:56.332655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:56.332655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.333437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:56.705710 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:56.707457 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:56.707770 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:56.707927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.708879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:56.708879 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:56.708879 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:56.708879 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:56.708879 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:56.708879 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:56.708879 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.708879 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:56.710784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.710784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:56.710784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:56.710784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:56.710784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:56.710784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:56.710784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:56.710784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:56.710784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:56.710784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:56.710784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:56.710784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:56.710784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:56.710784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:09:56.710784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:56.710784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:56.710784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.711184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:56.711552 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:56.711552 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:09:56.712113 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:56.712345 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.712956 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:56.712956 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:56.712956 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:56.712956 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:56.712956 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:56.712956 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:56.712956 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.712956 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:56.714175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.714175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:56.714175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:56.714175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:56.714175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:56.714175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:56.714175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:56.714175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:56.714175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:56.714175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:56.714175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:56.714175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:56.714175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:56.714175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:56.714175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:56.714175 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:56.714527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:56.714527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:56.714527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:56.714527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:56.714527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:56.714527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:56.714527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.714527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:56.715851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.715851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:56.715851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:56.715851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:56.715851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:56.715851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:56.715851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:56.715851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:56.715851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:56.715851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:56.715851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:56.715851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:56.715851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:56.715851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:09:56.715851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:09:56.715851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:56.716597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:56.717636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:56.717636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.717636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:56.717636 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:56.717636 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:56.718093 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:56.718382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.719114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:09:56.719114 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:56.719114 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:56.719114 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:56.719114 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:56.719114 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:56.719114 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.719114 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:56.720475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.720475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:09:56.720475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:56.720475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:56.720475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:56.720475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:56.720475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:56.720475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:56.720475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:56.720475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:09:56.720475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:56.720475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:09:56.720475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:56.720475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:09:56.720475 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:09:56.721203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:56.721203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:09:56.721203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:56.721203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:09:56.721203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:09:56.721203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:56.721203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:09:56.721203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.721203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:09:56.722211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.722211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:56.722211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:56.722211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:56.722211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:56.722211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:56.722211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:56.722211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:56.722211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:56.722211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:56.722211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:56.722211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:56.722211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:56.722211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:09:56.722211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:09:56.722211 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:56.722692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:56.723275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.723275 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:09:56.761648 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:09:56.761950 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:09:56.763017 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:56.763303 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:09:56.763440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.764311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:09:56.764311 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:56.764311 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:09:56.764311 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:09:56.764311 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:56.764311 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:09:56.764311 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.764311 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:09:56.766425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.766425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:09:56.766425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:09:56.766425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:09:56.766425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:09:56.766425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:09:56.766425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:56.766425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:09:56.766425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:09:56.766425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:09:56.766425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:09:56.766425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:09:56.766425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:09:56.766425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:09:56.766425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:09:56.766425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:56.766425 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:09:56.767203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:01.292553 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:01.293569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:01.328781 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:01.329220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.330136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:10:01.330136 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:01.330136 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:01.330136 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:01.330136 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:01.330136 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:01.330136 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.330136 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:01.331329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.331329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:01.331329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:01.331329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:01.331329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:01.331329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:01.331329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:01.331329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:01.331329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:01.331329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:01.331329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:01.331329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:01.331329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:01.331329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:10:01.331329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:01.331329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:01.331329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.332320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:01.749656 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:01.749656 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:01.749656 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:01.749656 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:10:01.749656 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:01.750456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:01.750740 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:01.750820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.751422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:01.751422 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:01.751422 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:01.751422 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:01.751422 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:01.751422 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:01.751422 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.751422 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:01.753283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.753283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:01.753283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:01.753283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:01.753283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:01.753283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:01.753283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:01.753283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:01.753283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:01.753283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:01.753283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:01.753283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:01.753283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:01.753283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:10:01.753283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:01.753283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:01.753283 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.754543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:01.755332 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:01.755332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.755332 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:01.755332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.755332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:01.755332 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:01.755332 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:01.755332 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:01.755332 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:01.755332 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:01.755332 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.755332 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:01.756369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.756369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:01.756369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:01.756369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:01.756369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:01.756369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:01.756369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:01.756369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:01.756369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:01.756369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:01.756369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:01.756369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:01.756369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:01.756369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:01.756369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:01.756369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.756948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:01.757587 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:01.758197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.758715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:01.758715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:01.758715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:01.758715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:01.758715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:01.758715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:01.758715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:01.758715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:01.758715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:01.758715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:01.758715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:01.758715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:01.758715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:01.758715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:01.758715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:01.758715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:01.758715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:01.759243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:01.759243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:01.759243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:01.759243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:01.759243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.759243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:01.759243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.759243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:01.759243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:01.759243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:01.759243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:01.759243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:01.759243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:01.759243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:01.759243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:01.759243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:01.759777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:01.760406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:01.760406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:01.760406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:01.760406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:01.760406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:01.760406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:01.760406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.760406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:01.761949 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:01.762174 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:01.762503 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:01.762770 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:01.762958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.763444 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:01.763444 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:01.763444 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:01.763444 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:01.763444 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:01.763444 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:01.763444 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.763444 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:01.764577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.764577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:01.764577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:01.764577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:01.764577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:01.764577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:01.764577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:01.764577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:01.764577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:01.764577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:01.764577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:01.764577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:01.764577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:01.764577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:10:01.764577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:01.764577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:01.764577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:01.765122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:06.293593 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:06.295194 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:06.332575 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:06.333079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.334320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:10:06.334320 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:06.334320 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:06.334320 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:06.334320 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:06.334320 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:06.334320 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.334320 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:06.335608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.335608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:06.335608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:06.335608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:06.335608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:06.335608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:06.335608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:06.335608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:06.335608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:06.335608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:06.335608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:06.335608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:06.335608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:06.335608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:10:06.335608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:06.335608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:06.335608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.336936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:06.749153 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:06.749448 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:06.749902 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:06.750935 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:10:06.752102 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:06.752473 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:06.752938 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:06.753303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.754425 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:06.754726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.755497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:10:06.755497 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:06.755497 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:06.755497 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:06.755497 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:06.755497 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:06.755497 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.755497 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:06.756401 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:06.758573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.758573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:06.758573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:06.758573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:06.758573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:06.758573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:06.758573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:06.758573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:06.758573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:06.758573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:06.758573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:06.758573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:06.758573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:06.758573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:10:06.758573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:06.758573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.760125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:06.761508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:06.762936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:06.762936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:06.762936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:06.762936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:06.762936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:06.762936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:06.762936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:06.762936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:06.762936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:06.762936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:06.762936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:06.762936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:06.762936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:06.762936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.762936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:06.763753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.763753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:06.763753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:06.763753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:06.763753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:06.763753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:06.763753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:06.763753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:06.763753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:06.763753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:06.763753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:06.763753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:06.763753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:06.763753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:10:06.763753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:10:06.763753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:06.764423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:06.764976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.764976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:06.764976 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:06.764976 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:06.764976 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:06.764976 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:06.764976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.764976 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:06.764976 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:06.764976 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:06.764976 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:06.765330 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:06.765330 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:06.765330 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.765330 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:06.765476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.765476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:06.765476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:06.765476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:06.765476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:06.765476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:06.765476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:06.765476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:06.765476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:06.765476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:06.765476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:06.765476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:06.765476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:06.765476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:10:06.765476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:06.765476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:06.765476 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.766025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:06.806921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:06.806921 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:06.806921 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:06.806921 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:06.806921 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:06.806921 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:06.806921 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.806921 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:06.808778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.808778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:06.808778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:06.808778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:06.808778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:06.808778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:06.808778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:06.808778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:06.808778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:06.808778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:06.808778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:06.808778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:06.808778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:06.808778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:06.808778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:06.808778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:06.809488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:06.809488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:06.809488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:06.809488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:06.809488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:06.809488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:06.809488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.809488 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:06.810602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.810602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:06.810602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:06.810602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:06.810602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:06.810602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:06.810602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:06.810602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:06.810602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:06.810602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:06.810602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:06.810602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:06.810602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:06.810602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:10:06.810602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:10:06.810602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:06.811243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:06.811916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:06.811916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:06.811916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:11.293696 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:11.295295 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:11.329083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:11.329492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.330367 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:10:11.330367 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:11.330367 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:11.330367 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:11.330367 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:11.330367 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:11.330367 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.330367 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:11.331612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.331612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:11.331612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:11.331612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:11.331612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:11.331612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:11.331612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:11.331612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:11.331612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:11.331612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:11.331612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:11.331612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:11.331612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:11.331612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:10:11.331612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:11.331612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:11.331612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.332177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:11.750646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:11.751588 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:11.751710 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:11.752372 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:10:11.753104 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:11.753516 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:11.753945 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:11.754240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.755247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:10:11.755247 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:11.755247 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:11.755247 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:11.755247 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:11.755247 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:11.755247 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.755247 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:11.756747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.756747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:11.756747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:11.756747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:11.756747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:11.756747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:11.756747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:11.756747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:11.756747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:11.756747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:11.756747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:11.756747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:11.756747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:11.756747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:10:11.756747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:11.756747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.757306 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:11.758004 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:11.758004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.758004 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:11.758497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.758753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:11.758753 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:11.758753 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:11.758753 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:11.758753 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:11.758753 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:11.758753 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.758753 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:11.760014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.760014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:11.760014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:11.760014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:11.760014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:11.760014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:11.760014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:11.760014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:11.760014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:11.760014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:11.760014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:11.760014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:11.760014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:11.760014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:11.760014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:11.760014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:11.760639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:11.760639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:11.760639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:11.760639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:11.760639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:11.760639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:11.760639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.760639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:11.760639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:11.760639 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:11.760639 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:11.760639 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:11.760639 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:11.760639 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:11.760639 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.760639 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:11.761460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.761460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:11.761460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:11.761460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:11.761460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:11.761460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:11.761460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:11.761460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:11.761460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:11.761460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:11.761460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:11.761460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:11.761460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:11.761460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:10:11.761460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:10:11.761460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:11.762069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:11.762775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.762775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:11.762775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.762775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:11.762775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:11.762775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:11.762775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:11.762775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:11.762775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:11.762775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:11.762775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:11.762775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:11.762775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:11.762775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:11.762775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:11.762775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:11.763391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:11.763391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:11.763391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:11.763391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:11.763391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:11.763391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:11.763391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:11.763391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:11.763391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.763391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:11.764250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.764250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:11.764250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:11.764250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:11.764250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:11.764250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:11.764250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:11.764250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:11.764250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:11.764250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:11.764250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:11.764250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:11.764250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:11.764250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:10:11.764250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:10:11.764250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:11.764818 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:11.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:11.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:11.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:11.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:11.765880 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:11.766117 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:11.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.766846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:10:11.766846 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:11.766846 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:11.766846 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:11.766846 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:11.766846 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:11.766846 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.766846 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:11.768719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.768719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:11.768719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:11.768719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:11.768719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:11.768719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:11.768719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:11.768719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:11.768719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:11.768719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:11.768719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:11.768719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:11.768719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:11.768719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:10:11.768719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:11.768719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:11.768719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:11.769229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:15.798212 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:15.810781 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 07 20:10:15.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=104575) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 07 20:10:15.811106 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Maintenance task: Fixing resource bfbf6c8f-1f7e-474c-a618-4e99355c0282 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:10:15.848099 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, resource={'id': 'bfbf6c8f-1f7e-474c-a618-4e99355c0282', 'name': 'private', 'tenant_id': '47ea4a7c5a154b528631c5537cfdb850', 'project_id': '47ea4a7c5a154b528631c5537cfdb850', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['49f10797-7993-4eac-ad9c-5db13bcf3a17', 'bdd6f685-b77d-459b-b386-e3ef09898997'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:35:01Z', 'updated_at': '2026-04-07T19:35:05Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39614}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:15.848517 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:15.849116 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-ca0b7fb0-3499-4804-b894-4bb867203f37, external_ids_update=None, columns={'tag': 39614}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:15.849310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:15.850203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Traceback (most recent call last):
Apr 07 20:10:15.850203 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:15.850203 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:15.850203 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:15.850203 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:15.850203 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:15.850203 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:15.850203 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:15.851504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Maintenance task: Failed to fix resource bfbf6c8f-1f7e-474c-a618-4e99355c0282 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:15.851504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:10:15.851504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:10:15.851504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:10:15.851504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:10:15.851504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:10:15.851504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 20:10:15.851504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:15.851504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:15.851504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:10:15.851504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:15.852113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:15.852113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:15.852113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:10:15.852113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:15.852113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:10:15.852113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:15.852113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:10:15.852113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:10:15.852113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:15.852113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:10:15.852113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:15.852113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:10:15.852113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:10:15.852113 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:15.852790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:10:15.852790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:15.852790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:10:15.852790 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Maintenance task: Fixing resource 92857a9a-261a-45c8-bdf2-793e5d5977e1 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:10:15.883510 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, resource={'id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'name': 'public', 'tenant_id': '47ea4a7c5a154b528631c5537cfdb850', 'project_id': '47ea4a7c5a154b528631c5537cfdb850', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['158905cc-b5be-42da-8777-3d7ded042b7c', '6de186a3-9e7c-4950-a1c6-817a37a68984'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-07T19:35:09Z', 'updated_at': '2026-04-07T19:35:17Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:15.884197 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:15.884590 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-783e27a6-53d0-42e0-a778-7125c7a0cff1, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:15.885001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:15.885864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Traceback (most recent call last):
Apr 07 20:10:15.885864 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:15.885864 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:15.885864 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:15.885864 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:15.885864 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:15.885864 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:15.885864 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:15.887000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Maintenance task: Failed to fix resource 92857a9a-261a-45c8-bdf2-793e5d5977e1 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:15.887000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:10:15.887000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:10:15.887000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:10:15.887000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:10:15.887000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:10:15.887000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 20:10:15.887000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:15.887000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:15.887000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:10:15.887000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:15.887552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:15.887552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:15.887552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:10:15.887552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:15.887552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:10:15.887552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:15.887552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:10:15.887552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:10:15.887552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:15.887552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:10:15.887552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:15.887552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:10:15.887552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:10:15.887552 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:15.888291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:10:15.888291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:15.888291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:10:15.888291 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Maintenance task: Fixing resource 246975ba-4717-4c89-a181-15f0da115b38 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:10:15.916018 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-246975ba-4717-4c89-a181-15f0da115b38, resource={'id': '246975ba-4717-4c89-a181-15f0da115b38', 'name': 'admin_net', 'tenant_id': 'c55e43aaf6164fb7ba8075ffd24bc8d2', 'project_id': 'c55e43aaf6164fb7ba8075ffd24bc8d2', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['4b75275b-2834-446a-a1bf-6e510e154273'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:40:24Z', 'updated_at': '2026-04-07T19:40:25Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 64449}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:15.916584 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-246975ba-4717-4c89-a181-15f0da115b38, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:15.917208 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-f0065b7a-ceb5-4313-9c13-1796e417df18, external_ids_update=None, columns={'tag': 64449}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:15.917303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:15.917970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Traceback (most recent call last):
Apr 07 20:10:15.917970 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:15.917970 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:15.917970 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:15.917970 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:15.917970 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:15.917970 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:15.917970 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:15.918875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Maintenance task: Failed to fix resource 246975ba-4717-4c89-a181-15f0da115b38 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:15.918875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:10:15.918875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:10:15.918875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:10:15.918875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:10:15.918875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:10:15.918875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 20:10:15.918875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:15.918875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:15.918875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:10:15.918875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:15.919496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:15.919496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:15.919496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:10:15.919496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:15.919496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:10:15.919496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:15.919496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:10:15.919496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:10:15.919496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:15.919496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:10:15.919496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:15.919496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:10:15.919496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:10:15.919496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:15.920270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:10:15.920270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:15.920270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:10:15.920270 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Maintenance task: Fixing resource 40ad0605-2aac-4da1-b108-03821a0aa715 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:10:15.943423 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-40ad0605-2aac-4da1-b108-03821a0aa715, resource={'id': '40ad0605-2aac-4da1-b108-03821a0aa715', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'tenant_id': '7e48d42664ae4580840a2aef59d52e53', 'project_id': '7e48d42664ae4580840a2aef59d52e53', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['afc68917-6901-4e08-99ad-5c3d8bb8a584'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:41:05Z', 'updated_at': '2026-04-07T19:41:05Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 12961}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:15.945410 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-40ad0605-2aac-4da1-b108-03821a0aa715, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:15.945733 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-7853e8c0-165f-48a8-8e65-36b87d07f16a, external_ids_update=None, columns={'tag': 12961}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:15.945819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:15.947033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Traceback (most recent call last):
Apr 07 20:10:15.947033 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:15.947033 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:15.947033 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:15.947033 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:15.947033 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:15.947033 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:15.947033 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:15.947371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Maintenance task: Failed to fix resource 40ad0605-2aac-4da1-b108-03821a0aa715 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:15.947371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:10:15.947371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:10:15.947371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:10:15.947371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:10:15.947371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:10:15.947371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 20:10:15.947371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:15.947371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:15.947371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:10:15.947371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:15.947722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:15.947722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:15.947722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:10:15.947722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:15.947722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:10:15.947722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:15.947722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:10:15.947722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:10:15.947722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:15.947722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:10:15.947722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:15.947722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:10:15.947722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:10:15.947722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:15.948152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:10:15.948152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:15.948152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:10:15.948152 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Maintenance task: Fixing resource 6e977c5e-85a0-4398-b359-5ba638de167e (type: routers) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:10:16.023554 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, resource={'id': '6e977c5e-85a0-4398-b359-5ba638de167e', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'project_id': '7e48d42664ae4580840a2aef59d52e53', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'external_fixed_ips': [{'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984', 'ip_address': '172.24.5.89'}, {'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c', 'ip_address': '2001:db8::d'}], 'enable_snat': True}, 'gw_port_id': '7f6e42e8-6279-4fd6-9649-d7b189f6dba8', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-a48jf', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'external_fixed_ips': [{'ip_address': '172.24.5.89', 'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984'}, {'ip_address': '2001:db8::d', 'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-07T19:41:06Z', 'updated_at': '2026-04-07T19:41:09Z', 'revision_number': 3, 'tenant_id': '7e48d42664ae4580840a2aef59d52e53'}, resource_type=routers, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:16.024036 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:16.024467 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "7f6e42e8-6279-4fd6-9649-d7b189f6dba8"')], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:16.024684 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "7f6e42e8-6279-4fd6-9649-d7b189f6dba8"')], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:16.024923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.025775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Traceback (most recent call last):
Apr 07 20:10:16.025775 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:16.025775 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:16.025775 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:16.025775 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:16.025775 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:16.025775 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.025775 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:16.026012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Unable to update router 6e977c5e-85a0-4398-b359-5ba638de167e. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.027492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Maintenance task: Failed to fix resource 6e977c5e-85a0-4398-b359-5ba638de167e (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.027492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:10:16.027492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:10:16.027492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:10:16.027492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:10:16.027492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:10:16.027492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 07 20:10:16.027492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 07 20:10:16.027492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 07 20:10:16.027492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 07 20:10:16.027492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 07 20:10:16.027893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 07 20:10:16.027893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 07 20:10:16.027893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:16.027893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.027893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:10:16.027893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:16.027893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:16.027893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.027893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:10:16.027893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:16.027893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:10:16.027893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:16.027893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:10:16.027893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:10:16.028599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:16.028599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:10:16.028599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:16.028599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:10:16.028599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:10:16.028599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:16.028599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:10:16.028599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.028599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:10:16.028599 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Maintenance task: Fixing resource 7f6e42e8-6279-4fd6-9649-d7b189f6dba8 (type: router_ports) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:10:16.137494 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, resource={'id': '7f6e42e8-6279-4fd6-9649-d7b189f6dba8', 'name': '', 'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'project_id': '', 'mac_address': 'fa:16:3e:18:2e:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e977c5e-85a0-4398-b359-5ba638de167e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984', 'ip_address': '172.24.5.89'}, {'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c', 'ip_address': '2001:db8::d'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000164077', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-07T19:41:06Z', 'updated_at': '2026-04-07T19:41:09Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:16.137916 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '6de186a3-9e7c-4950-a1c6-817a37a68984 158905cc-b5be-42da-8777-3d7ded042b7c', 'neutron:network_name': 'neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-6e977c5e-85a0-4398-b359-5ba638de167e'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::d/64', '172.24.5.89/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:16.138459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=7f6e42e8-6279-4fd6-9649-d7b189f6dba8, lrouter_port=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:16.138825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.139686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Traceback (most recent call last):
Apr 07 20:10:16.139686 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:16.139686 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:16.139686 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:16.139686 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:16.139686 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:16.139686 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.139686 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:16.140644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Maintenance task: Failed to fix resource 7f6e42e8-6279-4fd6-9649-d7b189f6dba8 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.140644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:10:16.140644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:10:16.140644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:10:16.140644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:10:16.140644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:10:16.140644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 07 20:10:16.140644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:16.140644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.140644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:10:16.140644 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:16.140974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:16.140974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.140974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:10:16.140974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:16.140974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:10:16.140974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:16.140974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:10:16.140974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:10:16.140974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:16.140974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:10:16.140974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:16.140974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:10:16.140974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:10:16.140974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:16.141426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:10:16.141426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.141426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:10:16.141426 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b9644eb1-26ef-4594-a237-6faab6b68998 None None] Maintenance task: Synchronization completed (took 0.33 seconds)
Apr 07 20:10:16.331526 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:16.331526 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:16.365862 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:16.366294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.367022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:10:16.367022 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:16.367022 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:16.367022 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:16.367022 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:16.367022 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:16.367022 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.367022 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:16.367902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.367902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:16.367902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:16.367902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:16.367902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:16.367902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:16.367902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:16.367902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:16.367902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:16.367902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:16.367902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:16.367902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:16.367902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:16.367902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:10:16.367902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:16.367902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.367902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.369180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:16.751263 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:16.752426 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:16.752656 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:16.752863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.753954 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:16.754214 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:16.754462 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:10:16.754868 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:16.755134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.755741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:16.755741 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:16.755741 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:16.755741 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:16.755741 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:16.755741 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:16.755741 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.755741 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:16.756739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.756739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:16.756739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:16.756739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:16.756739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.756739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:16.756739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:16.756739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:16.756739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.756739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:16.756739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:16.756739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:16.756739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:16.756739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:16.756739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:16.756739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:16.757647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:16.757647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:16.757647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:16.757647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:16.757647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:16.757647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:16.757647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.757647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:16.757647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:10:16.757647 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:16.757647 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:16.757647 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:16.757647 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:16.757647 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:16.757647 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.757647 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:16.758514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.758514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:16.758514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:16.758514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:16.758514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:16.758514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:16.758514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:16.758514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:16.758514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:16.758514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:16.758514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:16.758514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:16.758514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:16.758514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:10:16.758514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:10:16.758514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:16.759317 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:16.760161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:16.760161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.760161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:16.760161 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:16.761017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.761017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:16.761017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:16.761017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:16.761017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:16.761017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:16.761017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:16.761017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:16.761017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:16.761017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:16.761017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:16.761017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:16.761017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:16.761017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:10:16.761017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:16.761017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.761606 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:16.762143 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:16.762143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.762143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:16.762143 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:16.762143 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:16.762143 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:16.762143 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:16.762143 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:16.762143 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.762143 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:16.763700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.763700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:16.763700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:16.763700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:16.763700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.763700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:16.763700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:16.763700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:16.763700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.763700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:16.763700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:16.763700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:16.763700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:16.763700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:16.763700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:16.763700 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:16.764167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:16.764167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:16.764167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:16.764167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:16.764167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:16.764167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:16.764167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.764167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:16.765940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.765940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:16.765940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:16.765940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:16.765940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:16.765940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:16.765940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:16.765940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:16.765940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:16.765940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:16.765940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:16.765940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:16.765940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:16.765940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:10:16.765940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:10:16.765940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:16.766440 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:16.766941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.766941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:16.766941 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:16.766941 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:16.766941 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:16.767149 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:16.767312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.767827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:10:16.767827 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:16.767827 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:16.767827 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:16.767827 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:16.767827 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:16.767827 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.767827 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:16.768804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.768804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:16.768804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:16.768804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:16.768804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:16.768804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:16.768804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:16.768804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:16.768804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:16.768804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:16.768804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:16.768804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:16.768804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:16.768804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:10:16.768804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:16.768804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.768804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:16.769307 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:21.330833 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:21.333115 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:21.359171 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=449 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:10:21.368282 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:21.368497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.369127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:10:21.369127 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:21.369127 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:21.369127 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:21.369127 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:21.369127 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:21.369127 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.369127 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:21.370337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.370337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:21.370337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:21.370337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:21.370337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:21.370337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:21.370337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:21.370337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:21.370337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:21.370337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:21.370337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:21.370337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:21.370337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:21.370337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:10:21.370337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:21.370337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:21.370337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.370879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:21.751963 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:21.753735 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:21.753735 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:21.753929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.755018 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:21.755421 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:10:21.756213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:21.756213 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:21.756213 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:21.756213 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:21.756213 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:21.756213 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:21.756213 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.756213 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:21.756686 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:21.758702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.758702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:21.758702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:21.758702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:21.758702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:21.758702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:21.758702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:21.758702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:21.758702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:21.758702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:21.758702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:21.758702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:21.758702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:21.758702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:10:21.758702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:21.758702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:21.758702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.759575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:21.760450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.760450 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:21.760450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:10:21.760450 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:21.760450 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:21.760450 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:21.760450 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:21.760450 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:21.760450 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.760450 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:21.761495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.761495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:21.761495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:21.761495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:21.761495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:21.761495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:21.761495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:21.761495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:21.761495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:21.761495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:21.761495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:21.761495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:21.761495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:21.761495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:21.761495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:21.762456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:21.762456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:21.762456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:21.762456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:21.762456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:21.762456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:21.762456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:21.762456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.762456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:21.762456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:21.763073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.763073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:21.763073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:21.763073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:21.763073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:21.763073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:21.763073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:21.763073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:21.763073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:21.763073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:21.763073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:21.763073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:21.763073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:21.763073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:10:21.763073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:10:21.763073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:21.763557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:21.764106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:21.764106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.764106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:21.764106 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:21.764106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.764106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:21.764106 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:21.764106 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:21.764106 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:21.764106 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:21.764106 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:21.764106 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.764106 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:21.764829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.764829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:21.764829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:21.764829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:21.764829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:21.764829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:21.764829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:21.764829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:21.764829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:21.764829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:21.764829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:21.764829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:21.764829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:21.764829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:21.764829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:21.764829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:21.765304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:21.765304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:21.765304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:21.765304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:21.765304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:21.765304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:21.765304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.765304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:21.765948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.765948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:21.765948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:21.765948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:21.765948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:21.765948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:21.765948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:21.765948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:21.765948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:21.765948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:21.765948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:21.765948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:21.765948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:21.765948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:10:21.765948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:10:21.765948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:21.766419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:21.766925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.766925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:21.766925 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:21.766925 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:21.767135 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:21.767334 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:21.767478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.767958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:10:21.767958 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:21.767958 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:21.767958 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:21.767958 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:21.767958 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:21.767958 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.767958 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:21.769038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.769038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:21.769038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:21.769038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:21.769038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:21.769038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:21.769038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:21.769038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:21.769038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:21.769038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:21.769038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:21.769038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:21.769038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:21.769038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:10:21.769038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:21.769038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:21.769038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:21.769580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:26.331530 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:26.333384 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:26.369444 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:26.369725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.370526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:10:26.370526 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:26.370526 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:26.370526 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:26.370526 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:26.370526 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:26.370526 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.370526 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:26.371761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.371761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:26.371761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:26.371761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:26.371761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:26.371761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:26.371761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:26.371761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:26.371761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:26.371761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:26.371761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:26.371761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:26.371761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:26.371761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:10:26.371761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:26.371761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:26.371761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.372398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:26.753213 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:26.754634 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:26.755356 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:26.755978 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:26.756295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.756880 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:10:26.758049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:10:26.758049 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:26.758049 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:26.758049 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:26.758049 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:26.758049 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:26.758049 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.758049 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:26.758848 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:26.761101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.761101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:26.761101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:26.761101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:26.761101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:26.761101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:26.761101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:26.761101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:26.761101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:26.761101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:26.761101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:26.761101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:26.761101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:26.761101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:10:26.761101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:26.761101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.762121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:26.763158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.763158 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:26.763158 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:26.763784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:26.763784 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:26.763784 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:26.763784 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:26.763784 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:26.763784 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:26.763784 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.763784 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:26.765265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.765265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:26.765265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:26.765265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:26.765265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:26.765265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:26.765265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:26.765265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:26.765265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:26.765265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:26.765265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:26.765265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:26.765265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:26.765265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:26.765265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:26.765265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:26.765924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:26.765924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:26.765924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:26.765924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:26.765924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:26.765924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:26.765924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.765924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:26.765924 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:26.767513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.767513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:26.767513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:26.767513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:26.767513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:26.767513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:26.767513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:26.767513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:26.767513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:26.767513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:26.767513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:26.767513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:26.767513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:26.767513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:10:26.767513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:10:26.767513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:26.768097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:26.768721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:26.768721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.768721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:26.768721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.768721 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:26.769074 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:26.769785 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:26.769785 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:26.769785 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:26.769785 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:26.769785 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:26.769785 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:26.769785 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.769785 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:26.770174 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:26.771598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.771598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:26.771598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:26.771598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:26.771598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:26.771598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:26.771598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:26.771598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:26.771598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:26.771598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:26.771598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:26.771598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:26.771598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:26.771598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:26.771598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:26.771598 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:26.772088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:26.772088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:26.772088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:26.772088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:26.772088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:26.772088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:26.772088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.772088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:26.772088 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:26.774098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.774098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:26.774098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:26.774098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:26.774098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:26.774098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:26.774098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:26.774098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:26.774098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:26.774098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:26.774098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:26.774098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:26.774098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:26.774098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:10:26.774098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:10:26.774098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:26.774568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:26.775150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.775150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:26.775150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.775150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:10:26.775150 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:26.775150 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:26.775150 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:26.775150 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:26.775150 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:26.775150 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.775150 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:26.776767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.776767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:26.776767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:26.776767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:26.776767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:26.776767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:26.776767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:26.776767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:26.776767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:26.776767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:26.776767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:26.776767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:26.776767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:26.776767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:10:26.776767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:26.776767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:26.776767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:26.777361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:31.332324 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:31.333460 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:31.363181 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:31.363797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.364902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:10:31.364902 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:31.364902 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:31.364902 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:31.364902 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:31.364902 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:31.364902 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.364902 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:31.365798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.365798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:31.365798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:31.365798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:31.365798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:31.365798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:31.365798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:31.365798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:31.365798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:31.365798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:31.365798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:31.365798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:31.365798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:31.365798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:10:31.365798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:31.365798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:31.365798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.367096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:31.753903 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:31.755145 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:31.755433 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:31.755538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.756263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:10:31.756263 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:31.756263 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:31.756263 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:31.756263 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:31.756263 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:31.756263 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.756263 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:31.757875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.757875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:31.757875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:31.757875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:31.757875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:31.757875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:31.757875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:31.757875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:31.757875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:31.757875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:31.757875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:31.757875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:31.757875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:31.757875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:10:31.757875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:31.757875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.758371 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:31.759580 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:31.759580 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:10:31.760204 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:31.760204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.760541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:31.760541 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:31.760541 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:31.760541 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:31.760541 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:31.760541 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:31.760541 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.760541 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:31.761766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.761766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:31.761766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:31.761766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:31.761766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:31.761766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:31.761766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:31.761766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:31.761766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:31.761766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:31.761766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:31.761766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:31.761766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:31.761766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:31.761766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:31.761766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:31.762568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:31.762568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:31.762568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:31.762568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:31.762568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:31.762568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:31.762568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.762568 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:31.762886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.762886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:31.762886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:31.762886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:31.762886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:31.762886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:31.762886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:31.762886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:31.762886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:31.762886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:31.762886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:31.762886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:31.762886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:31.762886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:10:31.762886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:10:31.762886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:31.763501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:31.764182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:31.764182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.764182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:31.764182 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:31.764182 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:31.764182 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:31.764182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.764513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:31.764513 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:31.764513 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:31.764513 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:31.764513 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:31.764513 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:31.764513 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.764513 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:31.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:31.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:31.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:31.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:31.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:31.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:31.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:31.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:31.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:31.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:31.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:31.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:31.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:31.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:31.765543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:31.766153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:31.766153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:31.766153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:31.766153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:31.766153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:31.766153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:31.766153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.766153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:31.766634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.766634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:31.766634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:31.766634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:31.766634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:31.766634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:31.766634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:31.766634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:31.766634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:31.766634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:31.766634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:31.766634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:31.766634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:31.766634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:10:31.766634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:10:31.766634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:31.767279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:31.767971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.767971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:31.768972 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:31.769306 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:31.769633 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:31.769852 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:31.770034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.770557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:10:31.770557 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:31.770557 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:31.770557 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:31.770557 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:31.770557 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:31.770557 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.770557 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:31.771590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.771590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:31.771590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:31.771590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:31.771590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:31.771590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:31.771590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:31.771590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:31.771590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:31.771590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:31.771590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:31.771590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:31.771590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:31.771590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:10:31.771590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:31.771590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:31.771590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:31.772273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:36.332895 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:36.334190 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:36.368877 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:36.369217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.370136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:10:36.370136 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:36.370136 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:36.370136 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:36.370136 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:36.370136 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:36.370136 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.370136 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:36.372039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.372039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:36.372039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:36.372039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:36.372039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:36.372039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:36.372039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:36.372039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:36.372039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:36.372039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:36.372039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:36.372039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:36.372039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:36.372039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:10:36.372039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:36.372039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:36.372039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.372739 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:36.754838 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:36.756003 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:36.756366 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:36.756712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.757616 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:10:36.757616 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:36.757616 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:36.757616 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:36.757616 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:36.757616 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:36.757616 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.757616 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:36.759840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.759840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:36.759840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:36.759840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:36.759840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:36.759840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:36.759840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:36.759840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:36.759840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:36.759840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:36.759840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:36.759840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:36.759840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:36.759840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:10:36.759840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:36.759840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.761073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:36.762394 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:36.762394 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:10:36.762394 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:36.762394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.762394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:36.762394 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:36.762394 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:36.762394 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:36.762394 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:36.762394 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:36.762394 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.762394 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:36.763481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.763481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:36.763481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:36.763481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:36.763481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:36.763481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:36.763481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:36.763481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:36.763481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:36.763481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:36.763481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:36.763481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:36.763481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:36.763481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:36.763481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:36.763481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:36.764575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:36.764575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:36.764575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:36.764575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:36.764575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:36.764575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:36.764575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.764575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:36.765198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.765198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:36.765198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:36.765198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:36.765198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:36.765198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:36.765198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:36.765198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:36.765198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:36.765198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:36.765198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:36.765198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:36.765198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:36.765198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:10:36.765198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:10:36.765198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:36.765842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:36.766625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:36.766625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.766625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:36.766625 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:36.766625 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:36.766625 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:36.766625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.766947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:36.766947 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:36.766947 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:36.766947 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:36.766947 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:36.766947 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:36.766947 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.766947 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:36.767545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.767545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:36.767545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:36.767545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:36.767545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:36.767545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:36.767545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:36.767545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:36.767545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:36.767545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:36.767545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:36.767545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:36.767545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:36.767545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:36.767545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:36.767545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:36.768178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:36.768178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:36.768178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:36.768178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:36.768178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:36.768178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:36.768178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.768178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:36.768781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.768781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:36.768781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:36.768781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:36.768781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:36.768781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:36.768781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:36.768781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:36.768781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:36.768781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:36.768781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:36.768781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:36.768781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:36.768781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:10:36.768781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:10:36.768781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:36.769405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:36.769934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.769934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:36.769934 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:36.769934 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:36.770284 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:36.770492 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:36.770641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.771320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:10:36.771320 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:36.771320 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:36.771320 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:36.771320 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:36.771320 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:36.771320 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.771320 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:36.773271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.773271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:36.773271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:36.773271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:36.773271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:36.773271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:36.773271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:36.773271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:36.773271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:36.773271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:36.773271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:36.773271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:36.773271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:36.773271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:10:36.773271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:36.773271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:36.773271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:36.773753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:41.333548 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:41.335569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:41.369263 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:41.369548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.370241 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:10:41.370241 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:41.370241 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:41.370241 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:41.370241 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:41.370241 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:41.370241 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.370241 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:41.371524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.371524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:41.371524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:41.371524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:41.371524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:41.371524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:41.371524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:41.371524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:41.371524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:41.371524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:41.371524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:41.371524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:41.371524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:41.371524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:10:41.371524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:41.371524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:41.371524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.372358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:41.755429 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:41.756562 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:41.756904 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:41.757201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.758232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:10:41.758232 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:41.758232 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:41.758232 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:41.758232 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:41.758232 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:41.758232 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.758232 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:41.760418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.760418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:41.760418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:41.760418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:41.760418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:41.760418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:41.760418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:41.760418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:41.760418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:41.760418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:41.760418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:41.760418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:41.760418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:41.760418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:10:41.760418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:41.760418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.761236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:41.762184 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:41.762184 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:10:41.762184 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:41.762184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.762406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:41.762406 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:41.762406 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:41.762406 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:41.762406 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:41.762406 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:41.762406 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.762406 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:41.763179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.763179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:41.763179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:41.763179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:41.763179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:41.763179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:41.763179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:41.763179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:41.763179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:41.763179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:41.763179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:41.763179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:41.763179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:41.763179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:41.763179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:41.763179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:41.764186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:41.764186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:41.764186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:41.764186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:41.764186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:41.764186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:41.764186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.764186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:41.765312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.765312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:41.765312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:41.765312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:41.765312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:41.765312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:41.765312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:41.765312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:41.765312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:41.765312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:41.765312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:41.765312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:41.765312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:41.765312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:10:41.765312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:10:41.765312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:41.765810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:41.766318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:41.766318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.766318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:41.766318 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:41.766318 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:41.766457 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:41.766653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.767333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:41.767333 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:41.767333 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:41.767333 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:41.767333 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:41.767333 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:41.767333 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.767333 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:41.768234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.768234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:41.768234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:41.768234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:41.768234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:41.768234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:41.768234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:41.768234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:41.768234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:41.768234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:41.768234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:41.768234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:41.768234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:41.768234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:41.768234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:41.768234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:41.768715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:41.768715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:41.768715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:41.768715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:41.768715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:41.768715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:41.768715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.768715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:41.769052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.769052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:41.769052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:41.769052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:41.769052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:41.769052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:41.769052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:41.769052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:41.769052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:41.769052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:41.769052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:41.769052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:41.769052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:41.769052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:10:41.769052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:10:41.769052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:41.769521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:41.770052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.770052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:41.770052 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:41.770437 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:41.770858 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:41.771194 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:41.771354 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.771961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:10:41.771961 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:41.771961 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:41.771961 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:41.771961 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:41.771961 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:41.771961 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.771961 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:41.773786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.773786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:41.773786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:41.773786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:41.773786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:41.773786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:41.773786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:41.773786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:41.773786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:41.773786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:41.773786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:41.773786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:41.773786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:41.773786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:10:41.773786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:41.773786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:41.773786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:41.774256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:46.334157 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:46.335798 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:46.370821 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:46.371461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.371998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:10:46.371998 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:46.371998 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:46.371998 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:46.371998 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:46.371998 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:46.371998 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.371998 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:46.372871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.372871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:46.372871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:46.372871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:46.372871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:46.372871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:46.372871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:46.372871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:46.372871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:46.372871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:46.372871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:46.372871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:46.372871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:46.372871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:10:46.372871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:46.372871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:46.372871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.373643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:46.756140 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:46.757513 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:46.757867 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:46.758158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.759074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:10:46.759074 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:46.759074 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:46.759074 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:46.759074 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:46.759074 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:46.759074 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.759074 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:46.760458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.760458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:46.760458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:46.760458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:46.760458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:46.760458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:46.760458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:46.760458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:46.760458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:46.760458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:46.760458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:46.760458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:46.760458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:46.760458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:10:46.760458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:46.760458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.761157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:46.761925 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:46.761925 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:10:46.762229 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:46.762410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.762832 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:46.762832 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:46.762832 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:46.762832 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:46.762832 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:46.762832 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:46.762832 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.762832 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:46.763679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.763679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:46.763679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:46.763679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:46.763679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:46.763679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:46.763679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:46.763679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:46.763679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:46.763679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:46.763679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:46.763679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:46.763679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:46.763679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:46.763679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:46.763679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:46.764270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:46.764270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:46.764270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:46.764270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:46.764270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:46.764270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:46.764270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.764270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:46.764874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.764874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:46.764874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:46.764874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:46.764874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:46.764874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:46.764874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:46.764874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:46.764874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:46.764874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:46.764874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:46.764874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:46.764874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:46.764874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:10:46.764874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:10:46.764874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:46.765395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:46.765881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:46.765881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.765881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:46.766149 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:46.766444 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:46.766999 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:46.767298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.767768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:46.767768 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:46.767768 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:46.767768 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:46.767768 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:46.767768 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:46.767768 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.767768 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:46.769170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.769170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:46.769170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:46.769170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:46.769170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:46.769170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:46.769170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:46.769170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:46.769170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:46.769170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:46.769170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:46.769170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:46.769170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:46.769170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:46.769170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:46.769170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:46.769697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:46.769697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:46.769697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:46.769697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:46.769697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:46.769697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:46.769697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.769697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:46.771138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.771138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:46.771138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:46.771138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:46.771138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:46.771138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:46.771138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:46.771138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:46.771138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:46.771138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:46.771138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:46.771138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:46.771138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:46.771138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:10:46.771138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:10:46.771138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:46.771860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:46.772483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.772483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:46.772483 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:46.772483 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:46.772483 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:46.772483 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:46.772696 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.773299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:46.773299 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:46.773299 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:46.773299 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:46.773299 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:46.773299 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:46.773299 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.773299 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:46.776277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.776277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:46.776277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:46.776277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:46.776277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:46.776277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:46.776277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:46.776277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:46.776277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:46.776277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:46.776277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:46.776277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:46.776277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:46.776277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:10:46.776277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:46.776277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:46.776277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:46.776867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:51.335074 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:51.336226 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:51.371719 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:51.372147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.373160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:10:51.373160 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:51.373160 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:51.373160 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:51.373160 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:51.373160 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:51.373160 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.373160 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:51.374493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.374493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:51.374493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:51.374493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:51.374493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:51.374493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:51.374493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:51.374493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:51.374493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:51.374493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:51.374493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:51.374493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:51.374493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:51.374493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:10:51.374493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:51.374493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:51.374493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.375781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:51.756705 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:51.758068 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:51.758538 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:51.758804 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.759727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:10:51.759727 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:51.759727 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:51.759727 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:51.759727 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:51.759727 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:51.759727 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.759727 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:51.762075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.762075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:51.762075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:51.762075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:51.762075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:51.762075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:51.762075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:51.762075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:51.762075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:51.762075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:51.762075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:51.762075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:51.762075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:51.762075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:10:51.762075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:51.762075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.762763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:51.763416 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:51.763416 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:10:51.763416 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:51.763647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.764177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:51.764177 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:51.764177 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:51.764177 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:51.764177 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:51.764177 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:51.764177 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.764177 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:51.764886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.764886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:51.764886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:51.764886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:51.764886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:51.764886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:51.764886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:51.764886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:51.764886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:51.764886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:51.764886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:51.764886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:51.764886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:51.764886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:51.764886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:51.764886 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:51.765685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:51.765685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:51.765685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:51.765685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:51.765685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:51.765685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:51.765685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.765685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:51.765945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.765945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:51.765945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:51.765945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:51.765945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:51.765945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:51.765945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:51.765945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:51.765945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:51.765945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:51.765945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:51.765945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:51.765945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:51.765945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:10:51.765945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:10:51.765945 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:51.766416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:51.766876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:51.766876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.766876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:51.766876 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:51.767265 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:51.767665 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:51.767930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.768601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:10:51.768601 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:51.768601 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:51.768601 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:51.768601 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:51.768601 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:51.768601 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.768601 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:51.769937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.769937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:51.769937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:51.769937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:51.769937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:51.769937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:51.769937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:51.769937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:51.769937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:51.769937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:51.769937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:51.769937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:51.769937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:51.769937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:51.769937 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:51.770468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:51.770468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:51.770468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:51.770468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:51.770468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:51.770468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:51.770468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:51.770468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.770468 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:51.772162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.772162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:51.772162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:51.772162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:51.772162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:51.772162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:51.772162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:51.772162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:51.772162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:51.772162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:51.772162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:51.772162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:51.772162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:51.772162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:10:51.772162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:10:51.772162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:51.772617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:51.773103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.773103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:51.773103 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:51.773103 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:51.773463 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:51.773762 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:51.773845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.774412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:51.774412 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:51.774412 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:51.774412 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:51.774412 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:51.774412 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:51.774412 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.774412 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:51.775955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.775955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:51.775955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:51.775955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:51.775955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:51.775955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:51.775955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:51.775955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:51.775955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:51.775955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:51.775955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:51.775955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:51.775955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:51.775955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:10:51.775955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:51.775955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:51.775955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:51.776586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:56.335745 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:56.337259 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:56.378236 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:56.378590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.379169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:10:56.379169 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:56.379169 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:56.379169 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:56.379169 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:56.379169 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:56.379169 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.379169 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:56.380335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.380335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:56.380335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:56.380335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:56.380335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:56.380335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:56.380335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:56.380335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:56.380335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:56.380335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:56.380335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:56.380335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:56.380335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:56.380335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:10:56.380335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:56.380335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:56.380335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.380952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:56.757429 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:56.758857 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:56.759344 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:56.759657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.760783 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:10:56.760783 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:56.760783 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:56.760783 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:56.760783 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:56.760783 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:56.760783 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.760783 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:56.763189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.763189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:56.763189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:56.763189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:56.763189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:56.763189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:56.763189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:56.763189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:56.763189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:56.763189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:56.763189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:56.763189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:56.763189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:56.763189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:10:56.763189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:56.763189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.764279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:56.765318 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:56.765318 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:10:56.765318 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:56.765318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.765318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:56.765318 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:56.765318 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:56.765318 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:56.765318 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:56.765318 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:56.765318 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.765318 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:56.766178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.766178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:56.766178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:56.766178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:56.766178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:56.766178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:56.766178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:56.766178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:56.766178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:56.766178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:56.766178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:56.766178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:56.766178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:56.766178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:56.766178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:56.766178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:56.767167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:56.767167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:56.767167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:56.767167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:56.767167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:56.767167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:56.767167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.767167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:56.767167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.767167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:56.767167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:56.767167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:56.767167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:56.767167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:56.767167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:56.767167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:56.767957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:56.769205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:56.769205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:56.769205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:56.769205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:56.769205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:56.769205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:56.769205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:56.769205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:56.769205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:56.769205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.769205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:56.769205 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:56.769205 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:56.770013 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:56.770013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.770013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:10:56.770013 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:56.770013 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:56.770013 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:56.770013 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:56.770013 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:56.770013 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.770013 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:56.770013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.770013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:10:56.770013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:56.770013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:56.770786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:10:56.771641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.771641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:10:56.771641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.771641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:56.771641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:56.771641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:56.771641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:56.771641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:56.771641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:56.771641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:56.771641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:56.771641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:56.771641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:56.771641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:56.771641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:56.771641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:56.772020 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:56.772403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:56.772403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:56.772403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.772403 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:10:56.773008 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:10:56.773514 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:10:56.773999 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:56.774392 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:10:56.774539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.775064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:10:56.775064 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:56.775064 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:10:56.775064 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:10:56.775064 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:56.775064 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:10:56.775064 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.775064 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:10:56.776147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.776147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:10:56.776147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:10:56.776147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:10:56.776147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:10:56.776147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:10:56.776147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:56.776147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:10:56.776147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:10:56.776147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:10:56.776147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:10:56.776147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:10:56.776147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:10:56.776147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:10:56.776147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:10:56.776147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:56.776147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:10:56.776567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:01.336459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:01.338283 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:01.372598 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:01.373119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.374044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:11:01.374044 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:01.374044 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:01.374044 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:01.374044 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:01.374044 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:01.374044 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.374044 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:01.374941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.374941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:01.374941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:01.374941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:01.374941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:01.374941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:01.374941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:01.374941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:01.374941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:01.374941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:01.374941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:01.374941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:01.374941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:01.374941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:11:01.374941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:01.374941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:01.374941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.375729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:01.758244 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:01.759812 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:01.760436 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:01.760557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.761705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:11:01.761705 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:01.761705 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:01.761705 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:01.761705 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:01.761705 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:01.761705 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.761705 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:01.763491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.763491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:01.763491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:01.763491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:01.763491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:01.763491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:01.763491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:01.763491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:01.763491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:01.763491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:01.763491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:01.763491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:01.763491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:01.763491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:11:01.763491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:01.763491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.764658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:01.766281 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:01.766281 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:11:01.766281 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:01.766281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.766281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:01.766281 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:01.766281 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:01.766281 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:01.766281 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:01.766281 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:01.766281 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.766281 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:01.767153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.767153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:01.767153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:01.767153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:01.767153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:01.767153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:01.767153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:01.767153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:01.767153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:01.767153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:01.767153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:01.767153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:01.767153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:01.767153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:01.767153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:01.767153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:01.768925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:01.768925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:01.768925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:01.768925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:01.768925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:01.768925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:01.768925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.768925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:01.768925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.768925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:01.768925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:01.768925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:01.768925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:01.768925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:01.768925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:01.768925 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:01.769631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:01.770563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:01.770563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:01.770563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:01.770563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:01.770563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:01.770563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:01.770563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:01.770563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:01.770563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:01.770563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.770563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:01.770563 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:01.770563 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:01.771119 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:01.771119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.771119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:11:01.771119 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:01.771119 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:01.771119 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:01.771119 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:01.771119 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:01.771119 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.771119 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:01.771119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.771119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:01.771119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:01.771119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:01.771674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:01.772206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.772206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:01.772206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.772206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:01.772206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:01.772206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:01.772206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:01.772206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:01.772206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:01.772206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:01.772206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:01.772206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:01.772206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:01.772206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:01.772206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:01.772206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:01.772650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:01.773304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:01.773304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:01.773304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.773304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:01.773474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:01.773784 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:01.774487 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:01.774959 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:01.775239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.776089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:01.776089 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:01.776089 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:01.776089 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:01.776089 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:01.776089 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:01.776089 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.776089 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:01.777167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.777167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:01.777167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:01.777167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:01.777167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:01.777167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:01.777167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:01.777167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:01.777167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:01.777167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:01.777167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:01.777167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:01.777167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:01.777167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:11:01.777167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:01.777167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:01.777167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:01.777957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:06.337311 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:06.338412 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:06.371015 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:06.371247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.371936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:11:06.371936 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:06.371936 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:06.371936 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:06.371936 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:06.371936 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:06.371936 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.371936 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:06.374253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.374253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:06.374253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:06.374253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:06.374253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:06.374253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:06.374253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:06.374253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:06.374253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:06.374253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:06.374253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:06.374253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:06.374253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:06.374253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:11:06.374253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:06.374253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:06.374253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.375230 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:06.759067 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:06.760148 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:06.760445 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:06.760674 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.763690 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:11:06.763690 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:06.763690 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:06.763690 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:06.763690 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:06.763690 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:06.763690 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.763690 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:06.765754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.765754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:06.765754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:06.765754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:06.765754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:06.765754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:06.765754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:06.765754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:06.765754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:06.765754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:06.765754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:06.765754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:06.765754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:06.765754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:11:06.765754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:06.765754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.766439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:06.767154 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:06.767154 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:11:06.767154 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:06.767318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.767747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:11:06.767747 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:06.767747 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:06.767747 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:06.767747 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:06.767747 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:06.767747 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.767747 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:06.769401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.769401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:06.769401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:06.769401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:06.769401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:06.769401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:06.769401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:06.769401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:06.769401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:06.769401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:06.769401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:06.769401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:06.769401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:06.769401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:06.769401 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:06.769844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:06.769844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:06.769844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:06.769844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:06.769844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:06.769844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:06.769844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:06.769844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.769844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:06.769844 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:06.770867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.770867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:06.770867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:06.770867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:06.770867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:06.770867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:06.770867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:06.770867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:06.770867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:06.770867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:06.770867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:06.770867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:06.770867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:06.770867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:11:06.770867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:11:06.770867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:06.771825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:06.772464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:06.772464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.772464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:06.772464 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:06.772464 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:06.772464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.772464 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:11:06.772464 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:06.772464 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:06.772464 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:06.772464 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:06.772464 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:06.772464 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.772464 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:06.773365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.773365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:06.773365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:06.773365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:06.773365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:06.773365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:06.773365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:06.773365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:06.773365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:06.773365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:06.773365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:06.773365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:06.773365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:06.773365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:06.773365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:06.773910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:06.773910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:06.773910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:06.773910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:06.773910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:06.773910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:06.773910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:06.773910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.773910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:06.774373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.774373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:06.774373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:06.774373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:06.774373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:06.774373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:06.774373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:06.774373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:06.774373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:06.774373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:06.774373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:06.774373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:06.774373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:06.774373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:11:06.774373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:11:06.774373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:06.774840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:06.775386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.775386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:06.775386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:06.775386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:06.775786 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:06.776221 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:06.776506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.777373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:06.777373 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:06.777373 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:06.777373 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:06.777373 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:06.777373 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:06.777373 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.777373 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:06.779124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.779124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:06.779124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:06.779124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:06.779124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:06.779124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:06.779124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:06.779124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:06.779124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:06.779124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:06.779124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:06.779124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:06.779124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:06.779124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:11:06.779124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:06.779124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:06.779124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:06.779614 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:11.337932 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:11.339616 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:11.376726 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:11.377161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.378003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:11:11.378003 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:11.378003 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:11.378003 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:11.378003 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:11.378003 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:11.378003 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.378003 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:11.379037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.379037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:11.379037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:11.379037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:11.379037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:11.379037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:11.379037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:11.379037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:11.379037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:11.379037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:11.379037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:11.379037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:11.379037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:11.379037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:11:11.379037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:11.379037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:11.379037 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.379694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:11.759917 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:11.761141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:11.761389 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:11.761536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.762265 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:11.762265 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:11.762265 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:11.762265 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:11.762265 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:11.762265 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:11.762265 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.762265 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:11.763605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.763605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:11.763605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:11.763605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:11.763605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:11.763605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:11.763605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:11.763605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:11.763605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:11.763605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:11.763605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:11.763605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:11.763605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:11.763605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:11:11.763605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:11.763605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:11.763605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.764428 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:11.766564 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:11.767282 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:11:11.767774 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:11.768060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.768763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:11:11.768763 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:11.768763 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:11.768763 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:11.768763 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:11.768763 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:11.768763 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.768763 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:11.770246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.770246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:11.770246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:11.770246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:11.770246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:11.770246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:11.770246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:11.770246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:11.770246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:11.770246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:11.770246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:11.770246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:11.770246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:11.770246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:11.770246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:11.770781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:11.770781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:11.770781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:11.770781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:11.770781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:11.770781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:11.770781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:11.770781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.770781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:11.772184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.772184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:11.772184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:11.772184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:11.772184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:11.772184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:11.772184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:11.772184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:11.772184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:11.772184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:11.772184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:11.772184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:11.772184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:11.772184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:11:11.772184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:11:11.772184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:11.772628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:11.773116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:11.773116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.773116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:11.773116 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:11.773116 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:11.773594 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:11.773901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.774730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:11:11.774730 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:11.774730 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:11.774730 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:11.774730 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:11.774730 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:11.774730 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.774730 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:11.776046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.776046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:11.776046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:11.776046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:11.776046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:11.776046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:11.776046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:11.776046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:11.776046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:11.776046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:11.776046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:11.776046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:11.776046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:11.776046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:11.776046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:11.776446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:11.776446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:11.776446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:11.776446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:11.776446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:11.776446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:11.776446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:11.776446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.776446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:11.778699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.778699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:11.778699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:11.778699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:11.778699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:11.778699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:11.778699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:11.778699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:11.778699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:11.778699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:11.778699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:11.778699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:11.778699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:11.778699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:11:11.778699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:11:11.778699 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:11.779257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:11.779862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.779862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:11.779862 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:11.780247 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:11.782394 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:11.782394 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:11.782658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.783835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:11.783835 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:11.783835 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:11.783835 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:11.783835 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:11.783835 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:11.783835 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.783835 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:11.784775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.784775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:11.784775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:11.784775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:11.784775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:11.784775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:11.784775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:11.784775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:11.784775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:11.784775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:11.784775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:11.784775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:11.784775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:11.784775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:11:11.784775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:11.784775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:11.784775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:11.785891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:16.338550 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:16.340457 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:16.375778 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:16.376044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.376747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:11:16.376747 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:16.376747 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:16.376747 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:16.376747 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:16.376747 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:16.376747 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.376747 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:16.378124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.378124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:16.378124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:16.378124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:16.378124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:16.378124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:16.378124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:16.378124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:16.378124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:16.378124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:16.378124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:16.378124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:16.378124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:16.378124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:11:16.378124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:16.378124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:16.378124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.379231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:16.760656 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:16.761656 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:16.761926 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:16.762213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.762879 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:16.762879 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:16.762879 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:16.762879 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:16.762879 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:16.762879 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:16.762879 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.762879 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:16.764147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.764147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:16.764147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:16.764147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:16.764147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:16.764147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:16.764147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:16.764147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:16.764147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:16.764147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:16.764147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:16.764147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:16.764147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:16.764147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:11:16.764147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:16.764147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:16.764147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.764677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:16.766966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:16.767337 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:11:16.767670 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:16.767864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.768399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:11:16.768399 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:16.768399 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:16.768399 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:16.768399 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:16.768399 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:16.768399 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.768399 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:16.769289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.769289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:16.769289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:16.769289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:16.769289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:16.769289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:16.769289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:16.769289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:16.769289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:16.769289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:16.769289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:16.769289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:16.769289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:16.769289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:16.769289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:16.769972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:16.769972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:16.769972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:16.769972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:16.769972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:16.769972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:16.769972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:16.769972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.769972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:16.770546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.770546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:16.770546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:16.770546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:16.770546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:16.770546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:16.770546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:16.770546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:16.770546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:16.770546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:16.770546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:16.770546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:16.770546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:16.770546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:11:16.770546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:11:16.770546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:16.771340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:16.772503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:16.772503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.772503 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:16.772730 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:16.773612 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:16.774155 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:16.774409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.775052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:11:16.775052 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:16.775052 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:16.775052 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:16.775052 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:16.775052 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:16.775052 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.775052 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:16.776386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.776386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:16.776386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:16.776386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:16.776386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:16.776386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:16.776386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:16.776386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:16.776386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:16.776386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:16.776386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:16.776386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:16.776386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:16.776386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:16.776386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:16.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:16.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:16.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:16.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:16.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:16.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:16.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:16.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:16.777573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.777573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:16.777573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:16.777573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:16.777573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:16.777573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:16.777573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:16.777573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:16.777573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:16.777573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:16.777573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:16.777573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:16.777573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:16.777573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:11:16.777573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:11:16.777573 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:16.778108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:16.778622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.778622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:16.780020 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:16.780359 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:16.780766 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:16.781189 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:16.781404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.782129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:16.782129 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:16.782129 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:16.782129 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:16.782129 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:16.782129 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:16.782129 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.782129 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:16.783971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.783971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:16.783971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:16.783971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:16.783971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:16.783971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:16.783971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:16.783971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:16.783971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:16.783971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:16.783971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:16.783971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:16.783971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:16.783971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:11:16.783971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:16.783971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:16.783971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:16.784567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:21.339433 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:21.340856 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:21.365260 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=234 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:11:21.385263 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:21.385516 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.386257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:11:21.386257 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:21.386257 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:21.386257 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:21.386257 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:21.386257 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:21.386257 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.386257 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:21.387529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.387529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:21.387529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:21.387529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:21.387529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:21.387529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:21.387529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:21.387529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:21.387529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:21.387529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:21.387529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:21.387529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:21.387529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:21.387529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:11:21.387529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:21.387529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:21.387529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.388501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:21.761615 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:21.762666 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:21.762897 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:21.763124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.763667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:21.763667 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:21.763667 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:21.763667 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:21.763667 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:21.763667 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:21.763667 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.763667 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:21.764824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.764824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:21.764824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:21.764824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:21.764824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:21.764824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:21.764824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:21.764824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:21.764824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:21.764824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:21.764824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:21.764824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:21.764824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:21.764824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:11:21.764824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:21.764824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:21.764824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.766260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:21.768239 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:21.768239 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:11:21.768554 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:21.768714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.769453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:11:21.769453 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:21.769453 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:21.769453 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:21.769453 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:21.769453 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:21.769453 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.769453 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:21.770615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.770615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:21.770615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:21.770615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:21.770615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:21.770615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:21.770615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:21.770615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:21.770615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:21.770615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:21.770615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:21.770615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:21.770615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:21.770615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:21.770615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:21.772322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:21.772322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:21.772322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:21.772322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:21.772322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:21.772322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:21.772322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:21.772322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.772322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:21.772322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.772322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:21.772322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:21.772322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:21.772322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:21.772322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:21.773169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:21.773863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:21.773863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:21.773863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:21.773863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:21.773863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:21.773863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:21.773863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:21.773863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:21.773863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:21.773863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:21.773863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:21.773863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.773863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:21.773863 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:21.774146 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:21.774458 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:21.774807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.775585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:11:21.775585 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:21.775585 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:21.775585 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:21.775585 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:21.775585 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:21.775585 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.775585 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:21.776949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.776949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:21.776949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:21.776949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:21.776949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:21.776949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:21.776949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:21.776949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:21.776949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:21.776949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:21.776949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:21.776949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:21.776949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:21.776949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:21.776949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:21.777293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:21.777293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:21.777293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:21.777293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:21.777293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:21.777293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:21.777293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:21.777293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.777293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:21.778728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.778728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:21.778728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:21.778728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:21.778728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:21.778728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:21.778728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:21.778728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:21.778728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:21.778728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:21.778728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:21.778728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:21.778728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:21.778728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:11:21.778728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:11:21.778728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:21.779052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:21.779395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.779395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:21.780396 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:21.780674 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:21.780967 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:21.781232 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:21.781380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.781852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:21.781852 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:21.781852 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:21.781852 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:21.781852 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:21.781852 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:21.781852 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.781852 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:21.782842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.782842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:21.782842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:21.782842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:21.782842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:21.782842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:21.782842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:21.782842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:21.782842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:21.782842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:21.782842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:21.782842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:21.782842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:21.782842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:11:21.782842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:21.782842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:21.782842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:21.783331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:26.340015 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:26.341702 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:26.374417 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:26.375258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.375529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:11:26.375529 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:26.375529 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:26.375529 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:26.375529 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:26.375529 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:26.375529 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.375529 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:26.376796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.376796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:26.376796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:26.376796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:26.376796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:26.376796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:26.376796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:26.376796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:26.376796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:26.376796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:26.376796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:26.376796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:26.376796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:26.376796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:11:26.376796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:26.376796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:26.376796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.377489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:26.762337 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:26.763911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:26.764521 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:26.764774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.765813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-710502f2-943d-4610-9c91-9e31f0fca9df None None] Traceback (most recent call last):
Apr 07 20:11:26.765813 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:26.765813 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:26.765813 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:26.765813 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:26.765813 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:26.765813 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.765813 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:26.768758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-710502f2-943d-4610-9c91-9e31f0fca9df None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.768758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:26.768758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:26.768758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:26.768758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:26.768758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:26.768758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:26.768758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:26.768758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:26.768758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:26.768758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:26.768758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:26.768758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:26.768758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:11:26.768758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:26.768758 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.769709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:26.770629 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:26.770629 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:11:26.770629 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:26.770860 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.771819 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:11:26.771819 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:26.771819 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:26.771819 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:26.771819 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:26.771819 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:26.771819 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.771819 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:26.773234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.773234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:26.773234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:26.773234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:26.773234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:26.773234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:26.773234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:26.773234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:26.773234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:26.773234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:26.773234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:26.773234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:26.773234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:26.773234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:26.773234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:26.774271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:26.774271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:26.774271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:26.774271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:26.774271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:26.774271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:26.774271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:26.774271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.774271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:26.775234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.775234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:26.775234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:26.775234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:26.775234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:26.775234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:26.775234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:26.775234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:26.775234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:26.775234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:26.775234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:26.775234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:26.775234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:26.775234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:11:26.775234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:11:26.775234 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:26.776130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:26.777093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:26.777093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.777093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:26.777093 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:26.777093 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:26.777093 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:26.777093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.777880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:11:26.777880 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:26.777880 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:26.777880 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:26.777880 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:26.777880 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:26.777880 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.777880 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:26.779417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.779417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:26.779417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:26.779417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:26.779417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:26.779417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:26.779417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:26.779417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:26.779417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:26.779417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:26.779417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:26.779417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:26.779417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:26.779417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:26.779417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:26.779858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:26.779858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:26.779858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:26.779858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:26.779858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:26.779858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:26.779858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:26.779858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.779858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:26.781270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.781270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:26.781270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:26.781270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:26.781270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:26.781270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:26.781270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:26.781270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:26.781270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:26.781270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:26.781270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:26.781270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:26.781270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:26.781270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:11:26.781270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:11:26.781270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:26.781757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:26.782342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.782342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:26.782342 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:26.782342 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:26.782342 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:26.782558 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:26.782789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.783416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:26.783416 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:26.783416 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:26.783416 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:26.783416 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:26.783416 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:26.783416 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.783416 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:26.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:26.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:26.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:26.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:26.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:26.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:26.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:26.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:26.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:26.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:26.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:26.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:26.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:11:26.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:26.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:26.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:26.785654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:31.340664 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:31.342523 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:31.380710 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:31.381144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.382070 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:11:31.382070 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:31.382070 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:31.382070 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:31.382070 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:31.382070 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:31.382070 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.382070 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:31.383309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.383309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:31.383309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:31.383309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:31.383309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:31.383309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:31.383309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:31.383309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:31.383309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:31.383309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:31.383309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:31.383309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:31.383309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:31.383309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:11:31.383309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:31.383309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:31.383309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.384219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:31.762966 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:31.764250 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:31.764605 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:31.764823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.765929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Traceback (most recent call last):
Apr 07 20:11:31.765929 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:31.765929 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:31.765929 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:31.765929 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:31.765929 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:31.765929 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.765929 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:31.767773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-62aaec78-beb5-441b-ad2b-7dae1556f2d7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.767773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:31.767773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:31.767773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:31.767773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:31.767773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:31.767773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:31.767773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:31.767773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:31.767773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:31.767773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:31.767773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:31.767773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:31.767773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:11:31.767773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:31.767773 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.768333 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:31.769615 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:31.770119 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-710502f2-943d-4610-9c91-9e31f0fca9df None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:11:31.770538 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:31.770824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.771593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-710502f2-943d-4610-9c91-9e31f0fca9df None None] Traceback (most recent call last):
Apr 07 20:11:31.771593 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:31.771593 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:31.771593 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:31.771593 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:31.771593 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:31.771593 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.771593 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:31.772902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-710502f2-943d-4610-9c91-9e31f0fca9df None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.772902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:31.772902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:31.772902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:31.772902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:31.772902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:31.772902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:31.772902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:31.772902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:31.772902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:31.772902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:31.772902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:31.772902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:31.772902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:31.772902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:31.773455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:31.773455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:31.773455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:31.773455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:31.773455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:31.773455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:31.773455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:31.773455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.773455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:31.774109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-710502f2-943d-4610-9c91-9e31f0fca9df None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.774109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:31.774109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:31.774109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:31.774109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:31.774109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:31.774109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:31.774109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:31.774109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:31.774109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:31.774109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:31.774109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:31.774109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:31.774109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:11:31.774109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:11:31.774109 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:31.774585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:31.775131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:31.775131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.775131 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:31.775857 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:31.776446 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:31.776776 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:31.777010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.777465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:11:31.777465 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:31.777465 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:31.777465 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:31.777465 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:31.777465 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:31.777465 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.777465 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:31.778340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.778340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:31.778340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:31.778340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:31.778340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:31.778340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:31.778340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:31.778340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:31.778340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:31.778340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:31.778340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:31.778340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:31.778340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:31.778340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:31.778340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:31.778764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:31.778764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:31.778764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:31.778764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:31.778764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:31.778764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:31.778764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:31.778764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.778764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:31.779460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.779460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:31.779460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:31.779460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:31.779460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:31.779460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:31.779460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:31.779460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:31.779460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:31.779460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:31.779460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:31.779460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:31.779460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:31.779460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:11:31.779460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:11:31.779460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:31.779913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:31.780484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.780484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:31.782024 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:31.782427 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:31.782782 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:31.783129 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:31.783340 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.784008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:11:31.784008 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:31.784008 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:31.784008 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:31.784008 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:31.784008 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:31.784008 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.784008 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:31.785537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.785537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:31.785537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:31.785537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:31.785537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:31.785537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:31.785537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:31.785537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:31.785537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:31.785537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:31.785537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:31.785537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:31.785537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:31.785537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:11:31.785537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:31.785537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:31.785537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:31.786034 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:36.341508 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:36.343678 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:36.385180 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:36.385365 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.385822 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:11:36.385822 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:36.385822 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:36.385822 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:36.385822 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:36.385822 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:36.385822 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.385822 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:36.386791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.386791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:36.386791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:36.386791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:36.386791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:36.386791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:36.386791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:36.386791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:36.386791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:36.386791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:36.386791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:36.386791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:36.386791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:36.386791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:11:36.386791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:36.386791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:36.386791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.387226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:36.763754 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:36.765089 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:36.765518 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:36.765619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.766547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:36.766547 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:36.766547 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:36.766547 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:36.766547 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:36.766547 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:36.766547 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.766547 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:36.768289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.768289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:36.768289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:36.768289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:36.768289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:36.768289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:36.768289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:36.768289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:36.768289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:36.768289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:36.768289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:36.768289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:36.768289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:36.768289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:11:36.768289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:36.768289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:36.768289 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.768794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:36.770124 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:36.770717 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:11:36.771201 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:36.771396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.771948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:36.771948 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:36.771948 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:36.771948 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:36.771948 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:36.771948 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:36.771948 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.771948 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:36.773451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.773451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:36.773451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:36.773451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:36.773451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:36.773451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:36.773451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:36.773451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:36.773451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:36.773451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:36.773451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:36.773451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:36.773451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:36.773451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:36.773451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:36.773451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:36.773916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:36.773916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:36.773916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:36.773916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:36.773916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:36.773916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:36.773916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.773916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:36.775457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.775457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:36.775457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:36.775457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:36.775457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:36.775457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:36.775457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:36.775457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:36.775457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:36.775457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:36.775457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:36.775457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:36.775457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:36.775457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:11:36.775457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:11:36.775457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:36.775908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:36.776626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:36.776626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.776626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:36.776626 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:36.777071 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:36.777601 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:36.778106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.778919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:11:36.778919 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:36.778919 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:36.778919 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:36.778919 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:36.778919 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:36.778919 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.778919 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:36.779900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.779900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:36.779900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:36.779900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:36.779900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:36.779900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:36.779900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:36.779900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:36.779900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:36.779900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:36.779900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:36.779900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:36.779900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:36.779900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:36.779900 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:36.780405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:36.780405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:36.780405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:36.780405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:36.780405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:36.780405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:36.780405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:36.780405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.780405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:36.781201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.781201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:36.781201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:36.781201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:36.781201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:36.781201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:36.781201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:36.781201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:36.781201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:36.781201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:36.781201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:36.781201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:36.781201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:36.781201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:11:36.781201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:11:36.781201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:36.781650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:36.782170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.782170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:36.782486 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:36.783049 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:36.783563 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:36.784207 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:36.784455 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.786032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:11:36.786032 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:36.786032 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:36.786032 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:36.786032 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:36.786032 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:36.786032 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.786032 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:36.788045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.788045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:36.788045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:36.788045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:36.788045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:36.788045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:36.788045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:36.788045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:36.788045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:36.788045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:36.788045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:36.788045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:36.788045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:36.788045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:11:36.788045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:36.788045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:36.788045 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:36.788901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:41.342391 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:41.344310 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:41.382533 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:41.382935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.384025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:11:41.384025 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:41.384025 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:41.384025 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:41.384025 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:41.384025 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:41.384025 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.384025 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:41.385303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.385303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:41.385303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:41.385303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:41.385303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:41.385303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:41.385303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:41.385303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:41.385303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:41.385303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:41.385303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:41.385303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:41.385303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:41.385303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:11:41.385303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:41.385303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:41.385303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.386379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:41.764508 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:41.765588 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:41.765749 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:41.765909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.766474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:41.766474 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:41.766474 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:41.766474 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:41.766474 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:41.766474 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:41.766474 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.766474 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:41.767526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.767526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:41.767526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:41.767526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:41.767526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:41.767526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:41.767526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:41.767526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:41.767526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:41.767526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:41.767526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:41.767526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:41.767526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:41.767526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:11:41.767526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:41.767526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:41.767526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.768356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:41.770804 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:41.771230 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:11:41.771885 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:41.772296 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.772964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:41.772964 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:41.772964 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:41.772964 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:41.772964 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:41.772964 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:41.772964 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.772964 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:41.773806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.773806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:41.773806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:41.773806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:41.773806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:41.773806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:41.773806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:41.773806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:41.773806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:41.773806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:41.773806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:41.773806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:41.773806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:41.773806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:41.773806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:41.773806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:41.774429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:41.774429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:41.774429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:41.774429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:41.774429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:41.774429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:41.774429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.774429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:41.774753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.774753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:41.774753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:41.774753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:41.774753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:41.774753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:41.774753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:41.774753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:41.774753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:41.774753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:41.774753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:41.774753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:41.774753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:41.774753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:11:41.774753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:11:41.774753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:41.775417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:41.776133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:41.776133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.776133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:41.776862 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:41.777336 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:41.777544 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:41.777777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.778445 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:11:41.778445 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:41.778445 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:41.778445 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:41.778445 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:41.778445 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:41.778445 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.778445 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:41.779348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.779348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:41.779348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:41.779348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:41.779348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:41.779348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:41.779348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:41.779348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:41.779348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:41.779348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:41.779348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:41.779348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:41.779348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:41.779348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:41.779348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:41.780106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:41.780106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:41.780106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:41.780106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:41.780106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:41.780106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:41.780106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:41.780106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.780106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:41.780864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.780864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:41.780864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:41.780864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:41.780864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:41.780864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:41.780864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:41.780864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:41.780864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:41.780864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:41.780864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:41.780864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:41.780864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:41.780864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:11:41.780864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:11:41.780864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:41.781683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:41.782596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.782596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:41.782882 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:41.783152 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:41.783519 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:41.783743 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:41.783858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.784533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:41.784533 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:41.784533 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:41.784533 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:41.784533 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:41.784533 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:41.784533 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.784533 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:41.785458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.785458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:41.785458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:41.785458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:41.785458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:41.785458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:41.785458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:41.785458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:41.785458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:41.785458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:41.785458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:41.785458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:41.785458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:41.785458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:11:41.785458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:41.785458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:41.785458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:41.785972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:46.343748 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:46.346103 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:46.386559 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:46.387026 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.388075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:11:46.388075 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:46.388075 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:46.388075 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:46.388075 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:46.388075 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:46.388075 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.388075 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:46.390013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.390013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:46.390013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:46.390013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:46.390013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:46.390013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:46.390013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:46.390013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:46.390013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:46.390013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:46.390013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:46.390013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:46.390013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:46.390013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:11:46.390013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:46.390013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:46.390013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.390903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:46.765335 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:46.767337 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:46.767554 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:46.767790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.768979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:46.768979 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:46.768979 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:46.768979 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:46.768979 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:46.768979 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:46.768979 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.768979 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:46.771199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.771199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:46.771199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:46.771199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:46.771199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:46.771199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:46.771199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:46.771199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:46.771199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:46.771199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:46.771199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:46.771199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:46.771199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:46.771199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:11:46.771199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:46.771199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:46.771199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.772250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:46.773202 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:46.773202 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:11:46.773301 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:46.774148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.775170 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:46.775170 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:46.775170 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:46.775170 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:46.775170 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:46.775170 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:46.775170 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.775170 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:46.776840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.776840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:46.776840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:46.776840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:46.776840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:46.776840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:46.776840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:46.776840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:46.776840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:46.776840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:46.776840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:46.776840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:46.776840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:46.776840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:46.776840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:46.776840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:46.777436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:46.777436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:46.777436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:46.777436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:46.777436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:46.777436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:46.777436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.777436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:46.779323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.779323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:46.779323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:46.779323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:46.779323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:46.779323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:46.779323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:46.779323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:46.779323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:46.779323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:46.779323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:46.779323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:46.779323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:46.779323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:11:46.779323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:11:46.779323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:46.779848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:46.780554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:46.780554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.780554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:46.780554 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:46.780554 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:46.780787 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:46.781246 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.781870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:46.781870 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:46.781870 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:46.781870 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:46.781870 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:46.781870 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:46.781870 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.781870 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:46.782752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.782752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:46.782752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:46.782752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:46.782752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:46.782752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:46.782752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:46.782752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:46.782752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:46.782752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:46.782752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:46.782752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:46.782752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:46.782752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:46.782752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:46.782752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:46.783292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:46.783292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:46.783292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:46.783292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:46.783292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:46.783292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:46.783292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.783292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:46.783919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.783919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:46.783919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:46.783919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:46.783919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:46.783919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:46.783919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:46.783919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:46.783919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:46.783919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:46.783919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:46.783919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:46.783919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:46.783919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:11:46.783919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:11:46.783919 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:46.784395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:46.784854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.784854 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:46.784854 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:46.784854 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:46.785037 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:46.785250 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:46.785430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.785922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:46.785922 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:46.785922 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:46.785922 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:46.785922 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:46.785922 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:46.785922 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.785922 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:46.787000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.787000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:46.787000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:46.787000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:46.787000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:46.787000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:46.787000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:46.787000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:46.787000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:46.787000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:46.787000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:46.787000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:46.787000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:46.787000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:11:46.787000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:46.787000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:46.787000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:46.787500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:51.344628 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:51.346650 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:51.384424 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:51.384812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.385771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:11:51.385771 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:51.385771 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:51.385771 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:51.385771 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:51.385771 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:51.385771 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.385771 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:51.386801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.386801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:51.386801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:51.386801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:51.386801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:51.386801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:51.386801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:51.386801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:51.386801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:51.386801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:51.386801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:51.386801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:51.386801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:51.386801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:11:51.386801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:51.386801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:51.386801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.387949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:51.766699 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:51.768308 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:51.768923 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:51.768923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.769548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:51.769548 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:51.769548 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:51.769548 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:51.769548 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:51.769548 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:51.769548 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.769548 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:51.771797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.771797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:51.771797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:51.771797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:51.771797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:51.771797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:51.771797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:51.771797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:51.771797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:51.771797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:51.771797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:51.771797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:51.771797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:51.771797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:11:51.771797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:51.771797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:51.771797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.772704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:51.773524 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:51.773524 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:11:51.773524 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:51.773524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.774140 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:11:51.774140 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:51.774140 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:51.774140 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:51.774140 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:51.774140 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:51.774140 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.774140 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:51.775512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.775512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:51.775512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:51.775512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:51.775512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:51.775512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:51.775512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:51.775512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:51.775512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:51.775512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:51.775512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:51.775512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:51.775512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:51.775512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:51.775512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:51.776027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:51.776027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:51.776027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:51.776027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:51.776027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:51.776027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:51.776027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:51.776027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.776027 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:51.777183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.777183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:51.777183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:51.777183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:51.777183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:51.777183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:51.777183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:51.777183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:51.777183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:51.777183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:51.777183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:51.777183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:51.777183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:51.777183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:11:51.777183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:11:51.777183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:51.777605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:51.778096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:51.778096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.778096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:51.779996 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:51.780299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:51.780753 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:51.781055 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.781593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:51.781593 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:51.781593 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:51.781593 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:51.781593 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:51.781593 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:51.781593 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.781593 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:51.783114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.783114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:51.783114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:51.783114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:51.783114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:51.783114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:51.783114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:51.783114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:51.783114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:51.783114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:51.783114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:51.783114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:51.783114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:51.783114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:51.783114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:51.783114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:51.784282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:51.784282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:51.784282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:51.784282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:51.784282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:51.784282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:51.784282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.784282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:51.784891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.784891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:51.784891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:51.784891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:51.784891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:51.784891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:51.784891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:51.784891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:51.784891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:51.784891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:51.784891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:51.784891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:51.784891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:51.784891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:11:51.784891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:11:51.784891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:51.785777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:51.786757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.786757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:51.786757 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:51.786757 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:51.786757 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:51.786757 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:51.786757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.787249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:51.787249 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:51.787249 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:51.787249 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:51.787249 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:51.787249 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:51.787249 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.787249 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:51.789016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.789016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:51.789016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:51.789016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:51.789016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:51.789016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:51.789016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:51.789016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:51.789016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:51.789016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:51.789016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:51.789016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:51.789016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:51.789016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:11:51.789016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:51.789016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:51.789016 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:51.789896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:56.345392 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:56.347094 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:56.380424 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:56.380424 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.381378 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:11:56.381378 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:56.381378 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:56.381378 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:56.381378 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:56.381378 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:56.381378 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.381378 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:56.382361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.382361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:56.382361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:56.382361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:56.382361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:56.382361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:56.382361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:56.382361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:56.382361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:56.382361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:56.382361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:56.382361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:56.382361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:56.382361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:11:56.382361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:56.382361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:56.382361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.382829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:56.767422 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:56.768652 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:56.768922 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:56.769150 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.769933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:56.769933 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:56.769933 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:56.769933 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:56.769933 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:56.769933 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:56.769933 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.769933 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:56.771774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.771774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:56.771774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:56.771774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:56.771774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:56.771774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:56.771774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:56.771774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:56.771774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:56.771774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:56.771774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:56.771774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:56.771774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:56.771774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:11:56.771774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:56.771774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:56.771774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.772863 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:56.773671 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:56.773671 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:11:56.773858 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:56.774107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.774655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:11:56.774655 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:56.774655 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:56.774655 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:56.774655 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:56.774655 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:56.774655 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.774655 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:56.775543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.775543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:56.775543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:56.775543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:56.775543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:56.775543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:56.775543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:56.775543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:56.775543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:56.775543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:56.775543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:56.775543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:56.775543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:56.775543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:56.775543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:56.776304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:56.776304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:56.776304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:56.776304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:56.776304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:56.776304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:56.776304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:56.776304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.776304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:56.776698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.776698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:56.776698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:56.776698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:56.776698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:56.776698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:56.776698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:56.776698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:56.776698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:56.776698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:56.776698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:56.776698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:56.776698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:56.776698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:11:56.776698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:11:56.776698 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:56.777525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:56.778366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:56.778366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.778366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:56.780676 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:56.781062 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:56.781738 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:56.782056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.782678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:56.782678 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:56.782678 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:56.782678 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:56.782678 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:56.782678 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:56.782678 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.782678 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:56.783630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.783630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:11:56.783630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:56.783630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:56.783630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:56.783630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:56.783630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:56.783630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:56.783630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:56.783630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:11:56.783630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:56.783630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:11:56.783630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:56.783630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:11:56.783630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:11:56.783630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:56.784547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:11:56.784547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:56.784547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:11:56.784547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:11:56.784547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:56.784547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:11:56.784547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.784547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:11:56.785273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.785273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:56.785273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:56.785273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:56.785273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:56.785273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:56.785273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:56.785273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:56.785273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:56.785273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:56.785273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:56.785273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:56.785273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:56.785273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:11:56.785273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:11:56.785273 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:56.786302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:56.787361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.787361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:11:56.787361 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:11:56.787361 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:11:56.787361 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:56.787361 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:11:56.787361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.788298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:11:56.788298 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:56.788298 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:11:56.788298 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:11:56.788298 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:56.788298 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:11:56.788298 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.788298 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:11:56.788802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.788802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:11:56.788802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:11:56.788802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:11:56.788802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:11:56.788802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:11:56.788802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:56.788802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:11:56.788802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:11:56.788802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:11:56.788802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:11:56.788802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:11:56.788802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:11:56.788802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:11:56.788802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:11:56.788802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:56.788802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:11:56.789267 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:01.346228 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:01.347872 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:01.383298 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:01.383298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.383928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:12:01.383928 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:01.383928 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:01.383928 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:01.383928 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:01.383928 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:01.383928 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.383928 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:01.385213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.385213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:01.385213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:01.385213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:01.385213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:01.385213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:01.385213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:01.385213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:01.385213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:01.385213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:01.385213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:01.385213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:01.385213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:01.385213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:12:01.385213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:01.385213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:01.385213 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.385858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:01.768079 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:01.769268 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:01.769585 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:01.769867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.770958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:01.770958 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:01.770958 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:01.770958 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:01.770958 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:01.770958 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:01.770958 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.770958 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:01.772695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.772695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:01.772695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:01.772695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:01.772695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:01.772695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:01.772695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:01.772695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:01.772695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:01.772695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:01.772695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:01.772695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:01.772695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:01.772695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:12:01.772695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:01.772695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:01.772695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.774066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:01.775330 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:01.775330 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:12:01.775330 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:01.775330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.775330 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:12:01.775330 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:01.775330 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:01.775330 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:01.775330 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:01.775330 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:01.775330 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.775330 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:01.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:01.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:01.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:01.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:01.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:01.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:01.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:01.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:01.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:01.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:01.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:01.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:01.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:01.776817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:01.777567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:01.777567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:01.777567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:01.777567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:01.777567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:01.777567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:01.777567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:01.777567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.777567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:01.778442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.778442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:01.778442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:01.778442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:01.778442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:01.778442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:01.778442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:01.778442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:01.778442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:01.778442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:01.778442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:01.778442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:01.778442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:01.778442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:12:01.778442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:12:01.778442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:01.779279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:01.780136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:01.780136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.780136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:01.781114 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:01.781446 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:01.781926 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:01.782329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.783035 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:01.783035 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:01.783035 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:01.783035 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:01.783035 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:01.783035 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:01.783035 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.783035 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:01.784550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.784550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:01.784550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:01.784550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:01.784550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:01.784550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:01.784550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:01.784550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:01.784550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:01.784550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:01.784550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:01.784550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:01.784550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:01.784550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:01.784550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:01.784550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:01.785041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:01.785041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:01.785041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:01.785041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:01.785041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:01.785041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:01.785041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.785041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:01.786602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.786602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:01.786602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:01.786602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:01.786602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:01.786602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:01.786602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:01.786602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:01.786602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:01.786602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:01.786602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:01.786602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:01.786602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:01.786602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:12:01.786602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:12:01.786602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:01.787100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:01.787596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.787596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:01.787596 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:01.787596 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:01.787867 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:01.788273 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:01.788515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.789359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:01.789359 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:01.789359 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:01.789359 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:01.789359 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:01.789359 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:01.789359 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.789359 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:01.791436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.791436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:01.791436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:01.791436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:01.791436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:01.791436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:01.791436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:01.791436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:01.791436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:01.791436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:01.791436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:01.791436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:01.791436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:01.791436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:12:01.791436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:01.791436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:01.791436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:01.791908 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:06.347237 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:06.348612 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:06.382381 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:06.382923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.383559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:12:06.383559 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:06.383559 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:06.383559 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:06.383559 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:06.383559 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:06.383559 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.383559 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:06.385177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.385177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:06.385177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:06.385177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:06.385177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:06.385177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:06.385177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:06.385177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:06.385177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:06.385177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:06.385177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:06.385177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:06.385177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:06.385177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:12:06.385177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:06.385177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:06.385177 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.386219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:06.769299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:06.771156 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:06.771634 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:06.771918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.772916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:06.772916 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:06.772916 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:06.772916 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:06.772916 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:06.772916 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:06.772916 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.772916 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:06.775621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.775621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:06.775621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:06.775621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:06.775621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:06.775621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:06.775621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:06.775621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:06.775621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:06.775621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:06.775621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:06.775621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:06.775621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:06.775621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:12:06.775621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:06.775621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:06.775621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.776787 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:06.778142 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:06.778142 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:12:06.778142 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:06.778142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.778538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:12:06.778538 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:06.778538 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:06.778538 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:06.778538 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:06.778538 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:06.778538 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.778538 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:06.779838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.779838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:06.779838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:06.779838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:06.779838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:06.779838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:06.779838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:06.779838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:06.779838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:06.779838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:06.779838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:06.779838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:06.779838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:06.779838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:06.779838 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:06.780556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:06.780556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:06.780556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:06.780556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:06.780556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:06.780556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:06.780556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:06.780556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.780556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:06.780999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.780999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:06.780999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:06.780999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:06.780999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:06.780999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:06.780999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:06.780999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:06.780999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:06.780999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:06.780999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:06.780999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:06.780999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:06.780999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:12:06.780999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:12:06.780999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:06.781636 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:06.782223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:06.782223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.782223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:06.782223 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:06.782223 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:06.782613 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:06.783090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.783909 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:06.783909 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:06.783909 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:06.783909 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:06.783909 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:06.783909 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:06.783909 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.783909 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:06.785324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.785324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:06.785324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:06.785324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:06.785324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:06.785324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:06.785324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:06.785324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:06.785324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:06.785324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:06.785324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:06.785324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:06.785324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:06.785324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:06.785324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:06.785324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:06.785800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:06.785800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:06.785800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:06.785800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:06.785800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:06.785800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:06.785800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.785800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:06.786575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.786575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:06.786575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:06.786575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:06.786575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:06.786575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:06.786575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:06.786575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:06.786575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:06.786575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:06.786575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:06.786575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:06.786575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:06.786575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:12:06.786575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:12:06.786575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:06.787144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:06.787687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.787687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:06.787687 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:06.788124 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:06.788572 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:06.788787 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:06.788943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.789558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:06.789558 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:06.789558 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:06.789558 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:06.789558 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:06.789558 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:06.789558 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.789558 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:06.791671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.791671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:06.791671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:06.791671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:06.791671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:06.791671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:06.791671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:06.791671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:06.791671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:06.791671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:06.791671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:06.791671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:06.791671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:06.791671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:12:06.791671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:06.791671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:06.791671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:06.792188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:11.347773 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:11.349756 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:11.386796 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:11.387202 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.387827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:12:11.387827 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:11.387827 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:11.387827 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:11.387827 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:11.387827 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:11.387827 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.387827 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:11.388762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.388762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:11.388762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:11.388762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:11.388762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:11.388762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:11.388762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:11.388762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:11.388762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:11.388762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:11.388762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:11.388762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:11.388762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:11.388762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:12:11.388762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:11.388762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:11.388762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.389350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:11.770131 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:11.771376 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:11.771623 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:11.771997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.772538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:11.772538 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:11.772538 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:11.772538 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:11.772538 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:11.772538 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:11.772538 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.772538 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:11.773766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.773766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:11.773766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:11.773766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:11.773766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:11.773766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:11.773766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:11.773766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:11.773766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:11.773766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:11.773766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:11.773766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:11.773766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:11.773766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:12:11.773766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:11.773766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:11.773766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.774515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:11.776347 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:11.776785 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:12:11.777195 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:11.777416 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.777958 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:12:11.777958 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:11.777958 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:11.777958 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:11.777958 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:11.777958 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:11.777958 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.777958 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:11.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:11.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:11.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:11.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:11.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:11.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:11.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:11.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:11.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:11.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:11.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:11.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:11.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:11.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:11.779472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:11.779472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:11.779472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:11.779472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:11.779472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:11.779472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:11.779472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:11.779472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.779472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:11.780005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.780005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:11.780005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:11.780005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:11.780005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:11.780005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:11.780005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:11.780005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:11.780005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:11.780005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:11.780005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:11.780005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:11.780005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:11.780005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:12:11.780005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:12:11.780005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:11.780533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:11.781156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:11.781156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.781156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:11.782096 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:11.782820 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:11.783259 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:11.783474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.784075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:11.784075 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:11.784075 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:11.784075 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:11.784075 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:11.784075 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:11.784075 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.784075 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:11.785524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.785524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:11.785524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:11.785524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:11.785524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:11.785524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:11.785524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:11.785524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:11.785524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:11.785524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:11.785524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:11.785524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:11.785524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:11.785524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:11.785524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:11.785524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:11.785948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:11.785948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:11.785948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:11.785948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:11.785948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:11.785948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:11.785948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.785948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:11.787533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.787533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:11.787533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:11.787533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:11.787533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:11.787533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:11.787533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:11.787533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:11.787533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:11.787533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:11.787533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:11.787533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:11.787533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:11.787533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:12:11.787533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:12:11.787533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:11.787895 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:11.788376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.788376 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:11.788376 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:11.788376 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:11.788674 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:11.788903 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:11.789090 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.789604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:11.789604 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:11.789604 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:11.789604 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:11.789604 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:11.789604 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:11.789604 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.789604 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:11.791517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.791517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:11.791517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:11.791517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:11.791517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:11.791517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:11.791517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:11.791517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:11.791517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:11.791517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:11.791517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:11.791517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:11.791517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:11.791517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:12:11.791517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:11.791517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:11.791517 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:11.792032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:16.348301 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:16.350098 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:16.387697 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:16.387891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.388611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:12:16.388611 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:16.388611 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:16.388611 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:16.388611 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:16.388611 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:16.388611 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.388611 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:16.389777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.389777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:16.389777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:16.389777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:16.389777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:16.389777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:16.389777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:16.389777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:16.389777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:16.389777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:16.389777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:16.389777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:16.389777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:16.389777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:12:16.389777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:16.389777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:16.389777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.390853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:16.770836 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:16.772277 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:16.772666 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:16.772922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.774001 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:16.774001 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:16.774001 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:16.774001 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:16.774001 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:16.774001 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:16.774001 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.774001 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:16.776066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.776066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:16.776066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:16.776066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:16.776066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:16.776066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:16.776066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:16.776066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:16.776066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:16.776066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:16.776066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:16.776066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:16.776066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:16.776066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:12:16.776066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:16.776066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:16.776066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.776896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:16.777730 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:16.777730 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:12:16.778209 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:16.778530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.779390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:12:16.779390 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:16.779390 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:16.779390 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:16.779390 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:16.779390 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:16.779390 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.779390 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:16.780243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.780243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:16.780243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:16.780243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:16.780243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:16.780243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:16.780243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:16.780243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:16.780243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:16.780243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:16.780243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:16.780243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:16.780243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:16.780243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:16.780243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:16.781046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:16.781046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:16.781046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:16.781046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:16.781046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:16.781046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:16.781046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:16.781046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.781046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:16.781500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.781500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:16.781500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:16.781500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:16.781500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:16.781500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:16.781500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:16.781500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:16.781500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:16.781500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:16.781500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:16.781500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:16.781500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:16.781500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:12:16.781500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:12:16.781500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:16.782233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:16.783063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:16.783063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.783063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:16.783063 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:16.783398 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:16.784100 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:16.784612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.785562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:16.785562 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:16.785562 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:16.785562 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:16.785562 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:16.785562 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:16.785562 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.785562 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:16.786856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.786856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:16.786856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:16.786856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:16.786856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:16.786856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:16.786856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:16.786856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:16.786856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:16.786856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:16.786856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:16.786856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:16.786856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:16.786856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:16.786856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:16.786856 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:16.787369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:16.787369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:16.787369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:16.787369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:16.787369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:16.787369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:16.787369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.787369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:16.788880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.788880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:16.788880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:16.788880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:16.788880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:16.788880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:16.788880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:16.788880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:16.788880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:16.788880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:16.788880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:16.788880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:16.788880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:16.788880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:12:16.788880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:12:16.788880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:16.789410 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:16.789920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.789920 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:16.789920 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:16.789920 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:16.790087 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:16.790569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:16.790901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.791947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:16.791947 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:16.791947 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:16.791947 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:16.791947 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:16.791947 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:16.791947 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.791947 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:16.793465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.793465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:16.793465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:16.793465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:16.793465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:16.793465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:16.793465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:16.793465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:16.793465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:16.793465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:16.793465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:16.793465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:16.793465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:16.793465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:12:16.793465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:16.793465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:16.793465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:16.793936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:21.349138 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:21.350738 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:21.371265 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=240 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:12:21.389979 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:21.390302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.391156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:12:21.391156 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:21.391156 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:21.391156 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:21.391156 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:21.391156 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:21.391156 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.391156 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:21.392659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.392659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:21.392659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:21.392659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:21.392659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:21.392659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:21.392659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:21.392659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:21.392659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:21.392659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:21.392659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:21.392659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:21.392659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:21.392659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:12:21.392659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:21.392659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:21.392659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.393889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:21.771506 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:21.772510 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:21.772756 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:21.772914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.773719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:21.773719 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:21.773719 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:21.773719 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:21.773719 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:21.773719 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:21.773719 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.773719 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:21.775309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.775309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:21.775309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:21.775309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:21.775309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:21.775309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:21.775309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:21.775309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:21.775309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:21.775309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:21.775309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:21.775309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:21.775309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:21.775309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:12:21.775309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:21.775309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:21.775309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.775864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:21.777564 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:21.777878 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:12:21.778440 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:21.778744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.779542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:12:21.779542 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:21.779542 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:21.779542 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:21.779542 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:21.779542 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:21.779542 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.779542 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:21.780357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.780357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:21.780357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:21.780357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:21.780357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:21.780357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:21.780357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:21.780357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:21.780357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:21.780357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:21.780357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:21.780357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:21.780357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:21.780357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:21.780357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:21.780887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:21.780887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:21.780887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:21.780887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:21.780887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:21.780887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:21.780887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:21.780887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.780887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:21.781489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.781489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:21.781489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:21.781489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:21.781489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:21.781489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:21.781489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:21.781489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:21.781489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:21.781489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:21.781489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:21.781489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:21.781489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:21.781489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:12:21.781489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:12:21.781489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:21.781964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:21.782532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:21.782532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.782532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:21.783196 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:21.783619 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:21.784167 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:21.784619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.785303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:21.785303 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:21.785303 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:21.785303 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:21.785303 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:21.785303 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:21.785303 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.785303 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:21.786050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.786050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:21.786050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:21.786050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:21.786050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:21.786050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:21.786050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:21.786050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:21.786050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:21.786050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:21.786050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:21.786050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:21.786050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:21.786050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:21.786050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:21.786050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:21.786545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:21.786545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:21.786545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:21.786545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:21.786545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:21.786545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:21.786545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.786545 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:21.787201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.787201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:21.787201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:21.787201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:21.787201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:21.787201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:21.787201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:21.787201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:21.787201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:21.787201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:21.787201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:21.787201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:21.787201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:21.787201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:12:21.787201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:12:21.787201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:21.787759 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:21.788367 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.788367 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:21.789569 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:21.789906 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:21.790296 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:21.790519 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:21.790667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.791179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:21.791179 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:21.791179 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:21.791179 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:21.791179 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:21.791179 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:21.791179 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.791179 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:21.792558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.792558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:21.792558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:21.792558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:21.792558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:21.792558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:21.792558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:21.792558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:21.792558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:21.792558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:21.792558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:21.792558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:21.792558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:21.792558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:12:21.792558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:21.792558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:21.792558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:21.793207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:26.349888 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:26.352904 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:26.381519 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:26.381950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.382964 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:12:26.382964 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:26.382964 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:26.382964 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:26.382964 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:26.382964 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:26.382964 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.382964 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:26.384332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.384332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:26.384332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:26.384332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:26.384332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:26.384332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:26.384332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:26.384332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:26.384332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:26.384332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:26.384332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:26.384332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:26.384332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:26.384332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:12:26.384332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:26.384332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:26.384332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.385260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:26.772234 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:26.774438 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:26.774887 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:26.775287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.777025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:26.777025 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:26.777025 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:26.777025 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:26.777025 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:26.777025 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:26.777025 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.777025 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:26.778058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.778058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:26.778058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:26.778058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:26.778058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:26.778058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:26.778058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:26.778058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:26.778058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:26.778058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:26.778058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:26.778058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:26.778058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:26.778058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:12:26.778058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:26.778058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:26.778058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.778721 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:26.779431 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:26.779431 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:12:26.779926 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:26.780146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.780744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:12:26.780744 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:26.780744 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:26.780744 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:26.780744 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:26.780744 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:26.780744 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.780744 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:26.782101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.782101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:26.782101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:26.782101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:26.782101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:26.782101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:26.782101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:26.782101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:26.782101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:26.782101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:26.782101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:26.782101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:26.782101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:26.782101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:26.782101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:26.782682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:26.782682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:26.782682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:26.782682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:26.782682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:26.782682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:26.782682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:26.782682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.782682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:26.783774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.783774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:26.783774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:26.783774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:26.783774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:26.783774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:26.783774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:26.783774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:26.783774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:26.783774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:26.783774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:26.783774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:26.783774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:26.783774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:12:26.783774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:12:26.783774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:26.784639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:26.785497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:26.785497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.785497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:26.785497 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:26.785497 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:26.785497 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:26.785497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.786036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:12:26.786036 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:26.786036 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:26.786036 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:26.786036 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:26.786036 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:26.786036 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.786036 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:26.786702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.786702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:26.786702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:26.786702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:26.786702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:26.786702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:26.786702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:26.786702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:26.786702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:26.786702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:26.786702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:26.786702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:26.786702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:26.786702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:26.786702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:26.787399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:26.787399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:26.787399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:26.787399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:26.787399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:26.787399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:26.787399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:26.787399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.787399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:26.787855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.787855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:26.787855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:26.787855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:26.787855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:26.787855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:26.787855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:26.787855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:26.787855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:26.787855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:26.787855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:26.787855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:26.787855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:26.787855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:12:26.787855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:12:26.787855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:26.788580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:26.789350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.789350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:26.790047 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:26.790401 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:26.790977 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:26.791474 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:26.791782 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.792812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:26.792812 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:26.792812 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:26.792812 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:26.792812 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:26.792812 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:26.792812 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.792812 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:26.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:26.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:26.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:26.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:26.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:26.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:26.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:26.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:26.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:26.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:26.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:26.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:26.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:12:26.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:26.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:26.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:26.795218 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:31.350564 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:31.352196 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:31.389128 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:31.389519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.390400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:12:31.390400 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:31.390400 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:31.390400 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:31.390400 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:31.390400 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:31.390400 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.390400 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:31.391701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.391701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:31.391701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:31.391701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:31.391701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:31.391701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:31.391701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:31.391701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:31.391701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:31.391701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:31.391701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:31.391701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:31.391701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:31.391701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:12:31.391701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:31.391701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:31.391701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.392577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:31.773369 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:31.774929 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:31.775293 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:31.775563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.776538 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:31.776538 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:31.776538 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:31.776538 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:31.776538 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:31.776538 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:31.776538 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.776538 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:31.778505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.778505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:31.778505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:31.778505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:31.778505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:31.778505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:31.778505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:31.778505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:31.778505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:31.778505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:31.778505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:31.778505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:31.778505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:31.778505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:12:31.778505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:31.778505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:31.778505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.779286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:31.780184 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:31.780184 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:12:31.780184 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:31.780374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.780892 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:12:31.780892 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:31.780892 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:31.780892 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:31.780892 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:31.780892 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:31.780892 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.780892 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:31.782439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.782439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:31.782439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:31.782439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:31.782439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:31.782439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:31.782439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:31.782439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:31.782439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:31.782439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:31.782439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:31.782439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:31.782439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:31.782439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:31.782439 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:31.782942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:31.782942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:31.782942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:31.782942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:31.782942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:31.782942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:31.782942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:31.782942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.782942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:31.784059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.784059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:31.784059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:31.784059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:31.784059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:31.784059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:31.784059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:31.784059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:31.784059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:31.784059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:31.784059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:31.784059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:31.784059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:31.784059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:12:31.784059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:12:31.784059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:31.784522 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:31.785046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:31.785046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.785046 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:31.785046 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:31.785046 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:31.785440 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:31.785719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.786227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:31.786227 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:31.786227 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:31.786227 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:31.786227 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:31.786227 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:31.786227 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.786227 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:31.787254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.787254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:31.787254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:31.787254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:31.787254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:31.787254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:31.787254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:31.787254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:31.787254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:31.787254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:31.787254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:31.787254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:31.787254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:31.787254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:31.787254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:31.787254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:31.787778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:31.787778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:31.787778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:31.787778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:31.787778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:31.787778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:31.787778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.787778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:31.788379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.788379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:31.788379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:31.788379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:31.788379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:31.788379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:31.788379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:31.788379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:31.788379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:31.788379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:31.788379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:31.788379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:31.788379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:31.788379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:12:31.788379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:12:31.788379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:31.788883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:31.789449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.789449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:31.790415 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:31.790923 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:31.791309 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:31.791574 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:31.791757 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.792266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:31.792266 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:31.792266 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:31.792266 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:31.792266 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:31.792266 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:31.792266 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.792266 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:31.793382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.793382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:31.793382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:31.793382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:31.793382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:31.793382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:31.793382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:31.793382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:31.793382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:31.793382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:31.793382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:31.793382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:31.793382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:31.793382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:12:31.793382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:31.793382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:31.793382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:31.793944 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:36.351308 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:36.353415 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:36.395106 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:36.395453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.396489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:12:36.396489 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:36.396489 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:36.396489 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:36.396489 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:36.396489 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:36.396489 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.396489 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:36.397655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.397655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:36.397655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:36.397655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:36.397655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:36.397655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:36.397655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:36.397655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:36.397655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:36.397655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:36.397655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:36.397655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:36.397655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:36.397655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:12:36.397655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:36.397655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:36.397655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.398811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:36.774149 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:36.775505 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:36.775887 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:36.776223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.777159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:36.777159 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:36.777159 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:36.777159 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:36.777159 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:36.777159 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:36.777159 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.777159 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:36.778847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.778847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:36.778847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:36.778847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:36.778847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:36.778847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:36.778847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:36.778847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:36.778847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:36.778847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:36.778847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:36.778847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:36.778847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:36.778847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:12:36.778847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:36.778847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:36.778847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.779716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:36.780511 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:36.780511 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:12:36.780511 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:36.780691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.781419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:12:36.781419 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:36.781419 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:36.781419 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:36.781419 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:36.781419 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:36.781419 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.781419 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:36.782226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.782226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:36.782226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:36.782226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:36.782226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:36.782226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:36.782226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:36.782226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:36.782226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:36.782226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:36.782226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:36.782226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:36.782226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:36.782226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:36.782226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:36.783030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:36.783030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:36.783030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:36.783030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:36.783030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:36.783030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:36.783030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:36.783030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.783030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:36.783584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.783584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:36.783584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:36.783584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:36.783584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:36.783584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:36.783584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:36.783584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:36.783584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:36.783584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:36.783584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:36.783584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:36.783584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:36.783584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:12:36.783584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:12:36.783584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:36.784360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:36.785261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:36.785261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.785261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:36.785261 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:36.785469 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:36.785898 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:36.786165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.786677 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:36.786677 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:36.786677 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:36.786677 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:36.786677 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:36.786677 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:36.786677 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.786677 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:36.787949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.787949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:36.787949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:36.787949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:36.787949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:36.787949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:36.787949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:36.787949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:36.787949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:36.787949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:36.787949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:36.787949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:36.787949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:36.787949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:36.787949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:36.787949 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:36.788443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:36.788443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:36.788443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:36.788443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:36.788443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:36.788443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:36.788443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.788443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:36.789712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.789712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:36.789712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:36.789712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:36.789712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:36.789712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:36.789712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:36.789712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:36.789712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:36.789712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:36.789712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:36.789712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:36.789712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:36.789712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:12:36.789712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:12:36.789712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:36.790179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:36.790658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.790658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:36.790815 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:36.791136 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:36.791633 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:36.792088 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:36.792332 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.793178 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:36.793178 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:36.793178 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:36.793178 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:36.793178 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:36.793178 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:36.793178 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.793178 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:36.794874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.794874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:36.794874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:36.794874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:36.794874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:36.794874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:36.794874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:36.794874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:36.794874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:36.794874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:36.794874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:36.794874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:36.794874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:36.794874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:12:36.794874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:36.794874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:36.794874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:36.795366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:41.352078 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:41.353659 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:41.386764 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:41.387164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.387911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:12:41.387911 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:41.387911 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:41.387911 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:41.387911 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:41.387911 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:41.387911 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.387911 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:41.389190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.389190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:41.389190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:41.389190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:41.389190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:41.389190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:41.389190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:41.389190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:41.389190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:41.389190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:41.389190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:41.389190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:41.389190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:41.389190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:12:41.389190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:41.389190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:41.389190 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.389914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:41.774915 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:41.776343 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:41.776722 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:41.777160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.777816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:41.777816 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:41.777816 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:41.777816 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:41.777816 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:41.777816 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:41.777816 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.777816 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:41.779607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.779607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:41.779607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:41.779607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:41.779607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:41.779607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:41.779607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:41.779607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:41.779607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:41.779607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:41.779607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:41.779607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:41.779607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:41.779607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:12:41.779607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:41.779607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:41.779607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.780477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:41.781237 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:41.781237 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:12:41.781237 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:41.781237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.781635 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:12:41.781635 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:41.781635 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:41.781635 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:41.781635 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:41.781635 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:41.781635 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.781635 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:41.782209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.782209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:41.782209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:41.782209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:41.782209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:41.782209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:41.782209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:41.782209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:41.782209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:41.782209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:41.782209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:41.782209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:41.782209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:41.782209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:41.782209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:41.783269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:41.783269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:41.783269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:41.783269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:41.783269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:41.783269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:41.783269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:41.783269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.783269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:41.783269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.783269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:41.783269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:41.783269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:41.783269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:41.783269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:41.784028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:41.784643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:41.784643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:41.784643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:41.784643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:41.784643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:41.784643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:41.784643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:41.784643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:41.784643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:41.784643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:41.784643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:41.784643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.784643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:41.785497 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:41.785937 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:41.786472 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:41.786867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.787693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:41.787693 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:41.787693 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:41.787693 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:41.787693 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:41.787693 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:41.787693 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.787693 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:41.788959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.788959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:41.788959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:41.788959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:41.788959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:41.788959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:41.788959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:41.788959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:41.788959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:41.788959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:41.788959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:41.788959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:41.788959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:41.788959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:41.788959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:41.788959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:41.789664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:41.789664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:41.789664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:41.789664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:41.789664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:41.789664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:41.789664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.789664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:41.790789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.790789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:41.790789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:41.790789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:41.790789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:41.790789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:41.790789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:41.790789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:41.790789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:41.790789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:41.790789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:41.790789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:41.790789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:41.790789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:12:41.790789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:12:41.790789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:41.791981 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:41.792950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.792950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:41.792950 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:41.792950 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:41.792950 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:41.792950 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:41.792950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.793615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:41.793615 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:41.793615 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:41.793615 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:41.793615 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:41.793615 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:41.793615 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.793615 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:41.795059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.795059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:41.795059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:41.795059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:41.795059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:41.795059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:41.795059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:41.795059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:41.795059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:41.795059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:41.795059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:41.795059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:41.795059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:41.795059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:12:41.795059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:41.795059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:41.795059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:41.795612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:46.352671 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:46.354398 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:46.391209 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:46.391784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.392686 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:12:46.392686 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:46.392686 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:46.392686 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:46.392686 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:46.392686 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:46.392686 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.392686 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:46.393862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.393862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:46.393862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:46.393862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:46.393862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:46.393862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:46.393862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:46.393862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:46.393862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:46.393862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:46.393862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:46.393862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:46.393862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:46.393862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:12:46.393862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:46.393862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:46.393862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.394849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:46.775630 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:46.777031 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:46.777472 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:46.777747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.778576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:46.778576 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:46.778576 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:46.778576 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:46.778576 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:46.778576 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:46.778576 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.778576 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:46.779855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.779855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:46.779855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:46.779855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:46.779855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:46.779855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:46.779855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:46.779855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:46.779855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:46.779855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:46.779855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:46.779855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:46.779855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:46.779855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:12:46.779855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:46.779855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:46.779855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.780456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:46.780974 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:46.780974 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:12:46.781353 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:46.781554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.782146 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:12:46.782146 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:46.782146 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:46.782146 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:46.782146 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:46.782146 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:46.782146 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.782146 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:46.783544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.783544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:46.783544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:46.783544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:46.783544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:46.783544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:46.783544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:46.783544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:46.783544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:46.783544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:46.783544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:46.783544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:46.783544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:46.783544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:46.783544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:46.784054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:46.784054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:46.784054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:46.784054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:46.784054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:46.784054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:46.784054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:46.784054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.784054 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:46.784591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.784591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:46.784591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:46.784591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:46.784591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:46.784591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:46.784591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:46.784591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:46.784591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:46.784591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:46.784591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:46.784591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:46.784591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:46.784591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:12:46.784591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:12:46.784591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:46.785050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:46.785632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:46.785632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.785632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:46.785908 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:46.786548 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:46.787373 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:46.787810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.788688 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:46.788688 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:46.788688 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:46.788688 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:46.788688 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:46.788688 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:46.788688 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.788688 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:46.790210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.790210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:46.790210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:46.790210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:46.790210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:46.790210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:46.790210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:46.790210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:46.790210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:46.790210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:46.790210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:46.790210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:46.790210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:46.790210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:46.790210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:46.790210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:46.790641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:46.790641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:46.790641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:46.790641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:46.790641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:46.790641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:46.790641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.790641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:46.792605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.792605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:46.792605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:46.792605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:46.792605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:46.792605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:46.792605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:46.792605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:46.792605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:46.792605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:46.792605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:46.792605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:46.792605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:46.792605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:12:46.792605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:12:46.792605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:46.793153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:46.793675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.793675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:46.793675 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:46.793675 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:46.793962 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:46.794374 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:46.794624 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.795534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:46.795534 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:46.795534 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:46.795534 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:46.795534 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:46.795534 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:46.795534 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.795534 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:46.796620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.796620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:46.796620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:46.796620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:46.796620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:46.796620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:46.796620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:46.796620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:46.796620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:46.796620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:46.796620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:46.796620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:46.796620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:46.796620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:12:46.796620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:46.796620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:46.796620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:46.797163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:51.353173 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:51.354162 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:51.396701 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:51.396916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.397670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:12:51.397670 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:51.397670 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:51.397670 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:51.397670 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:51.397670 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:51.397670 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.397670 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:51.399712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.399712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:51.399712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:51.399712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:51.399712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:51.399712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:51.399712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:51.399712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:51.399712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:51.399712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:51.399712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:51.399712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:51.399712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:51.399712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:12:51.399712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:51.399712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:51.399712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:51.776210 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:51.777420 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:51.777719 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:51.777930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.778693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:51.778693 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:51.778693 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:51.778693 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:51.778693 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:51.778693 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:51.778693 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.778693 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:51.780563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.780563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:51.780563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:51.780563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:51.780563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:51.780563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:51.780563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:51.780563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:51.780563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:51.780563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:51.780563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:51.780563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:51.780563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:51.780563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:12:51.780563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:51.780563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:51.780563 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.781276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:51.781758 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:51.781758 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:12:51.781758 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:51.781868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.782412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:12:51.782412 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:51.782412 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:51.782412 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:51.782412 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:51.782412 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:51.782412 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.782412 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:51.783533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.783533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:51.783533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:51.783533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:51.783533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:51.783533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:51.783533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:51.783533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:51.783533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:51.783533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:51.783533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:51.783533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:51.783533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:51.783533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:51.783533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:51.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:51.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:51.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:51.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:51.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:51.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:51.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:51.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:51.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:51.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:51.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:51.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:51.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:51.785612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:51.786136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:51.786136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:51.786136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:51.786136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:51.786136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:51.786136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:51.786136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:51.786136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:51.786136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:51.786136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:51.786136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:51.786136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.786136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:51.786472 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:51.786893 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:51.787258 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:51.787632 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.788098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:51.788098 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:51.788098 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:51.788098 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:51.788098 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:51.788098 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:51.788098 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.788098 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:51.788738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.788738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:51.788738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:51.788738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:51.788738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:51.788738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:51.788738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:51.788738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:51.788738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:51.788738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:51.788738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:51.788738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:51.788738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:51.788738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:51.788738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:51.788738 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:51.789430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:51.789430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:51.789430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:51.789430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:51.789430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:51.789430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:51.789430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.789430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:51.789740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.789740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:51.789740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:51.789740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:51.789740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:51.789740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:51.789740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:51.789740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:51.789740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:51.789740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:51.789740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:51.789740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:51.789740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:51.789740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:12:51.789740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:12:51.789740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:51.790359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:51.791122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.791122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:51.793396 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:51.793794 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:51.794152 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:51.794433 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:51.794626 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.795232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:51.795232 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:51.795232 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:51.795232 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:51.795232 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:51.795232 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:51.795232 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.795232 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:51.796412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.796412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:51.796412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:51.796412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:51.796412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:51.796412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:51.796412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:51.796412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:51.796412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:51.796412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:51.796412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:51.796412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:51.796412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:51.796412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:12:51.796412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:51.796412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:51.796412 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:51.796969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:56.353831 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:56.355632 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:56.392267 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:56.392490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.393098 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:12:56.393098 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:56.393098 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:56.393098 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:56.393098 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:56.393098 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:56.393098 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.393098 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:56.394290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.394290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:56.394290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:56.394290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:56.394290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:56.394290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:56.394290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:56.394290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:56.394290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:56.394290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:56.394290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:56.394290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:56.394290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:56.394290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:12:56.394290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:56.394290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:56.394290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.395187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:56.776911 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:56.778215 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:56.778399 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:56.778551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.779160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:56.779160 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:56.779160 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:56.779160 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:56.779160 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:56.779160 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:56.779160 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.779160 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:56.780853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.780853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:56.780853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:56.780853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:56.780853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:56.780853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:56.780853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:56.780853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:56.780853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:56.780853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:56.780853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:56.780853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:56.780853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:56.780853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:12:56.780853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:56.780853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:56.780853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.781762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:56.782801 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:56.782801 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:12:56.782801 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:56.782801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.783171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:12:56.783171 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:56.783171 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:56.783171 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:56.783171 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:56.783171 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:56.783171 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.783171 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:56.784578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.784578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:56.784578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:56.784578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:56.784578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:56.784578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:56.784578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:56.784578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:56.784578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:56.784578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:56.784578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:56.784578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:56.784578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:56.784578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:56.784578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:56.785019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:56.785019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:56.785019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:56.785019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:56.785019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:56.785019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:56.785019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:56.785019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.785019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:56.786308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.786308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:56.786308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:56.786308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:56.786308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:56.786308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:56.786308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:56.786308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:56.786308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:56.786308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:56.786308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:56.786308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:56.786308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:56.786308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:12:56.786308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:12:56.786308 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:56.786741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:56.787206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:56.787206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.787206 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:56.787206 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:56.787328 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:56.787702 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:56.787957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.788534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:56.788534 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:56.788534 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:56.788534 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:56.788534 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:56.788534 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:56.788534 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.788534 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:56.789902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.789902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:12:56.789902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:56.789902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:56.789902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:56.789902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:56.789902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:56.789902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:56.789902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:56.789902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:12:56.789902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:56.789902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:12:56.789902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:56.789902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:12:56.789902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:12:56.789902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:56.790393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:12:56.790393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:56.790393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:12:56.790393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:12:56.790393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:56.790393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:12:56.790393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.790393 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:12:56.791825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.791825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:56.791825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:56.791825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:56.791825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:56.791825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:56.791825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:56.791825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:56.791825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:56.791825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:56.791825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:56.791825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:56.791825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:56.791825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:12:56.791825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:12:56.791825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:56.792309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:56.792839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.792839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:12:56.794543 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:12:56.795231 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:12:56.795799 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:56.796352 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:12:56.796668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.797676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:12:56.797676 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:56.797676 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:12:56.797676 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:12:56.797676 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:56.797676 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:12:56.797676 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.797676 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:12:56.799808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.799808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:12:56.799808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:12:56.799808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:12:56.799808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:12:56.799808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:12:56.799808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:56.799808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:12:56.799808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:12:56.799808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:12:56.799808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:12:56.799808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:12:56.799808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:12:56.799808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:12:56.799808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:12:56.799808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:56.799808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:12:56.800311 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:01.354595 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:01.355736 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:01.390747 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:01.390966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.391734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:13:01.391734 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:01.391734 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:01.391734 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:01.391734 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:01.391734 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:01.391734 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.391734 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:01.392789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.392789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:01.392789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:01.392789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:01.392789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:01.392789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:01.392789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:01.392789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:01.392789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:01.392789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:01.392789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:01.392789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:01.392789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:01.392789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:13:01.392789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:01.392789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:01.392789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.393947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:01.777807 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:01.779061 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:01.779449 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:01.779720 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.780936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:01.780936 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:01.780936 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:01.780936 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:01.780936 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:01.780936 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:01.780936 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.780936 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:01.783726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.783726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:01.783726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:01.783726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:01.783726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:01.783726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:01.783726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:01.783726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:01.783726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:01.783726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:01.783726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:01.783726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:01.783726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:01.783726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:13:01.783726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:01.783726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:01.783726 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.785062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:01.786143 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:01.786143 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:13:01.786143 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:01.786143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.786461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:13:01.786461 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:01.786461 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:01.786461 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:01.786461 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:01.786461 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:01.786461 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.786461 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:01.788184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.788184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:01.788184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:01.788184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:01.788184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:01.788184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:01.788184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:01.788184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:01.788184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:01.788184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:01.788184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:01.788184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:01.788184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:01.788184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:01.788184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:01.789111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:01.789111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:01.789111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:01.789111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:01.789111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:01.789111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:01.789111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:01.789111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.789111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:01.789111 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:01.789884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.789884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:01.789884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:01.789884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:01.789884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:01.789884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:01.789884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:01.789884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:01.789884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:01.789884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:01.789884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:01.789884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:01.789884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:01.789884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:13:01.789884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:13:01.789884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:01.790584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:01.791160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:01.791160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.791160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:01.791160 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:01.791160 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:01.791160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.791584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:01.791584 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:01.791584 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:01.791584 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:01.791584 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:01.791584 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:01.791584 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.791584 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:01.792421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.792421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:01.792421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:01.792421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:01.792421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:01.792421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:01.792421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:01.792421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:01.792421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:01.792421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:01.792421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:01.792421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:01.792421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:01.792421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:01.792421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:01.792421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:01.792957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:01.792957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:01.792957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:01.792957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:01.792957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:01.792957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:01.792957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.792957 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:01.793489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.793489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:01.793489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:01.793489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:01.793489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:01.793489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:01.793489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:01.793489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:01.793489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:01.793489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:01.793489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:01.793489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:01.793489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:01.793489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:13:01.793489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:13:01.793489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:01.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:01.794933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.794933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:01.795057 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:01.795393 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:01.795841 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:01.796131 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:01.796310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.797005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:01.797005 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:01.797005 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:01.797005 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:01.797005 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:01.797005 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:01.797005 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.797005 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:01.798138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.798138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:01.798138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:01.798138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:01.798138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:01.798138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:01.798138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:01.798138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:01.798138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:01.798138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:01.798138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:01.798138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:01.798138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:01.798138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:13:01.798138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:01.798138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:01.798138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:01.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:06.355213 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:06.356334 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:06.386517 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:06.387247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.387462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:13:06.387462 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:06.387462 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:06.387462 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:06.387462 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:06.387462 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:06.387462 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.387462 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:06.388128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.388128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:06.388128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:06.388128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:06.388128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:06.388128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:06.388128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:06.388128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:06.388128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:06.388128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:06.388128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:06.388128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:06.388128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:06.388128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:13:06.388128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:06.388128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:06.388128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.388943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:06.778460 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:06.779680 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:06.779868 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:06.780014 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.780630 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:06.780630 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:06.780630 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:06.780630 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:06.780630 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:06.780630 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:06.780630 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.780630 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:06.782597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.782597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:06.782597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:06.782597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:06.782597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:06.782597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:06.782597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:06.782597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:06.782597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:06.782597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:06.782597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:06.782597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:06.782597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:06.782597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:13:06.782597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:06.782597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:06.782597 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.783245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:06.784470 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:06.784889 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:13:06.785389 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:06.785694 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.786417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:13:06.786417 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:06.786417 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:06.786417 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:06.786417 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:06.786417 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:06.786417 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.786417 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:06.787210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.787210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:06.787210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:06.787210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:06.787210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:06.787210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:06.787210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:06.787210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:06.787210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:06.787210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:06.787210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:06.787210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:06.787210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:06.787210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:06.787210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:06.787692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:06.787692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:06.787692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:06.787692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:06.787692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:06.787692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:06.787692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:06.787692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.787692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:06.788320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.788320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:06.788320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:06.788320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:06.788320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:06.788320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:06.788320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:06.788320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:06.788320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:06.788320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:06.788320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:06.788320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:06.788320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:06.788320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:13:06.788320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:13:06.788320 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:06.788899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:06.789543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:06.789543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.789543 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:06.789543 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:06.789701 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:06.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:06.790658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.791561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:06.791561 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:06.791561 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:06.791561 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:06.791561 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:06.791561 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:06.791561 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.791561 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:06.792903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.792903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:06.792903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:06.792903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:06.792903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:06.792903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:06.792903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:06.792903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:06.792903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:06.792903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:06.792903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:06.792903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:06.792903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:06.792903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:06.792903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:06.792903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:06.793421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:06.793421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:06.793421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:06.793421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:06.793421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:06.793421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:06.793421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.793421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:06.794939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.794939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:06.794939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:06.794939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:06.794939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:06.794939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:06.794939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:06.794939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:06.794939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:06.794939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:06.794939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:06.794939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:06.794939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:06.794939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:13:06.794939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:13:06.794939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:06.795422 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:06.795939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.795939 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:06.795939 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:06.795939 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:06.796312 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:06.796529 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:06.796714 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.797404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:06.797404 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:06.797404 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:06.797404 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:06.797404 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:06.797404 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:06.797404 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.797404 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:06.799116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.799116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:06.799116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:06.799116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:06.799116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:06.799116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:06.799116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:06.799116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:06.799116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:06.799116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:06.799116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:06.799116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:06.799116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:06.799116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:13:06.799116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:06.799116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:06.799116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:06.799704 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:11.355855 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:11.357407 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:11.391781 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:11.392078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.392752 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:13:11.392752 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:11.392752 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:11.392752 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:11.392752 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:11.392752 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:11.392752 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.392752 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:11.393650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.393650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:11.393650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:11.393650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:11.393650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:11.393650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:11.393650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:11.393650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:11.393650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:11.393650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:11.393650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:11.393650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:11.393650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:11.393650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:13:11.393650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:11.393650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:11.393650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.394679 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:11.779309 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:11.780595 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:11.780875 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:11.781210 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.782367 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:11.782367 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:11.782367 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:11.782367 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:11.782367 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:11.782367 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:11.782367 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.782367 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:11.784041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.784041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:11.784041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:11.784041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:11.784041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:11.784041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:11.784041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:11.784041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:11.784041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:11.784041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:11.784041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:11.784041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:11.784041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:11.784041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:13:11.784041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:11.784041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:11.784041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.784933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:11.785782 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:11.785782 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:13:11.786092 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:11.786373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.787138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:13:11.787138 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:11.787138 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:11.787138 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:11.787138 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:11.787138 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:11.787138 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.787138 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:11.787960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.787960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:11.787960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:11.787960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:11.787960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:11.787960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:11.787960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:11.787960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:11.787960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:11.787960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:11.787960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:11.787960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:11.787960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:11.787960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:11.787960 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:11.789072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:11.789072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:11.789072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:11.789072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:11.789072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:11.789072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:11.789072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:11.789072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.789072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:11.789072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.789072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:11.789072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:11.789072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:11.789072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:11.789072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:11.789821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:11.790675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:11.790675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:11.790675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:11.790675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:11.790675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:11.790675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:11.790675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:11.790675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:11.790675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:11.790675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:11.790675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:11.790675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.790675 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:11.790675 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:11.790675 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:11.791262 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:11.791262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.791262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:11.791262 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:11.791262 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:11.791262 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:11.791262 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:11.791262 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:11.791262 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.791262 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:11.792397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.792397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:11.792397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:11.792397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:11.792397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:11.792397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:11.792397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:11.792397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:11.792397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:11.792397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:11.792397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:11.792397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:11.792397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:11.792397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:11.792397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:11.792397 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:11.792841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:11.792841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:11.792841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:11.792841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:11.792841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:11.792841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:11.792841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.792841 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:11.794085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.794085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:11.794085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:11.794085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:11.794085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:11.794085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:11.794085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:11.794085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:11.794085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:11.794085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:11.794085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:11.794085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:11.794085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:11.794085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:13:11.794085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:13:11.794085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:11.794577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:11.795123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.795123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:11.795626 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:11.796230 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:11.796579 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:11.796788 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:11.796930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.797670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:11.797670 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:11.797670 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:11.797670 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:11.797670 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:11.797670 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:11.797670 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.797670 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:11.799017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.799017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:11.799017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:11.799017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:11.799017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:11.799017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:11.799017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:11.799017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:11.799017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:11.799017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:11.799017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:11.799017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:11.799017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:11.799017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:13:11.799017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:11.799017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:11.799017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:11.799586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:16.401048 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:16.401048 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:16.431476 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:16.431962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.433021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Traceback (most recent call last):
Apr 07 20:13:16.433021 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:16.433021 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:16.433021 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:16.433021 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:16.433021 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:16.433021 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.433021 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:16.434182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-0a82cac9-36a2-40a2-8600-d67b99897060 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.434182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:16.434182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:16.434182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:16.434182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:16.434182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:16.434182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:16.434182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:16.434182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:16.434182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:16.434182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:16.434182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:16.434182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:16.434182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:13:16.434182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:16.434182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:16.434182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.435255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:16.780041 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:16.781236 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:16.781546 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:16.781790 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.782712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:16.782712 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:16.782712 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:16.782712 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:16.782712 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:16.782712 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:16.782712 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.782712 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:16.784419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.784419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:16.784419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:16.784419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:16.784419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:16.784419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:16.784419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:16.784419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:16.784419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:16.784419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:16.784419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:16.784419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:16.784419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:16.784419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:13:16.784419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:16.784419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:16.784419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.785149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:16.785802 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:16.786126 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:13:16.786560 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:16.786762 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.787360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:13:16.787360 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:16.787360 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:16.787360 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:16.787360 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:16.787360 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:16.787360 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.787360 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:16.788338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.788338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:16.788338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:16.788338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:16.788338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:16.788338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:16.788338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:16.788338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:16.788338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:16.788338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:16.788338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:16.788338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:16.788338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:16.788338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:16.788338 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:16.788845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:16.788845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:16.788845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:16.788845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:16.788845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:16.788845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:16.788845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:16.788845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.788845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:16.789619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.789619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:16.789619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:16.789619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:16.789619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:16.789619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:16.789619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:16.789619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:16.789619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:16.789619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:16.789619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:16.789619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:16.789619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:16.789619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:13:16.789619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:13:16.789619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:16.790077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:16.790799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:16.790799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.790799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:16.790799 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:16.790799 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:16.790799 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:16.791075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.791523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:16.791523 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:16.791523 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:16.791523 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:16.791523 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:16.791523 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:16.791523 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.791523 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:16.793110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.793110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:16.793110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:16.793110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:16.793110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:16.793110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:16.793110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:16.793110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:16.793110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:16.793110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:16.793110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:16.793110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:16.793110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:16.793110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:16.793110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:16.793110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:16.794145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:16.794145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:16.794145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:16.794145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:16.794145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:16.794145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:16.794145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.794145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:16.794145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.794145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:16.794145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:16.794145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:16.794145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:16.794145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:16.794145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:16.794145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:16.795224 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:16.795921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:16.795921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:16.795921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:16.795921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:16.795921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:16.795921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:16.795921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:16.795921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.795921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:16.796329 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:16.796919 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:16.797528 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:16.797856 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:16.798075 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.798655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:16.798655 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:16.798655 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:16.798655 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:16.798655 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:16.798655 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:16.798655 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.798655 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:16.799546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.799546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:16.799546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:16.799546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:16.799546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:16.799546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:16.799546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:16.799546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:16.799546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:16.799546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:16.799546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:16.799546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:16.799546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:16.799546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:13:16.799546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:16.799546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:16.799546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:16.799918 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:21.356926 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:21.358736 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:21.382262 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=241 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:13:21.394913 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:21.395248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.395935 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:13:21.395935 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:21.395935 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:21.395935 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:21.395935 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:21.395935 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:21.395935 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.395935 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:21.396775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.396775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:21.396775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:21.396775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:21.396775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:21.396775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:21.396775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:21.396775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:21.396775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:21.396775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:21.396775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:21.396775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:21.396775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:21.396775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:13:21.396775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:21.396775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:21.396775 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.397399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:21.780711 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:21.781892 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:21.782190 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:21.782417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.783373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:21.783373 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:21.783373 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:21.783373 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:21.783373 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:21.783373 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:21.783373 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.783373 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:21.785432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.785432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:21.785432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:21.785432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:21.785432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:21.785432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:21.785432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:21.785432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:21.785432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:21.785432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:21.785432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:21.785432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:21.785432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:21.785432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:13:21.785432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:21.785432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:21.785432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.786295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:21.787294 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:21.787294 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:13:21.787294 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:21.787519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.788160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:13:21.788160 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:21.788160 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:21.788160 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:21.788160 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:21.788160 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:21.788160 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.788160 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:21.789171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.789171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:21.789171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:21.789171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:21.789171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:21.789171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:21.789171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:21.789171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:21.789171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:21.789171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:21.789171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:21.789171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:21.789171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:21.789171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:21.789171 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:21.790085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:21.790085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:21.790085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:21.790085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:21.790085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:21.790085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:21.790085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:21.790085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.790085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:21.790085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.790085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:21.790085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:21.790085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:21.790085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:21.790085 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:21.790844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:21.791913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:21.791913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:21.791913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:21.791913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:21.791913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:21.791913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:21.791913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:21.791913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:21.791913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:21.791913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:21.791913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:21.791913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.791913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:21.791913 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:21.791913 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:21.792682 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:21.792682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.792682 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:21.792682 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:21.792682 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:21.792682 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:21.792682 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:21.792682 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:21.792682 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.792682 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:21.793764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.793764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:21.793764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:21.793764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:21.793764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:21.793764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:21.793764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:21.793764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:21.793764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:21.793764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:21.793764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:21.793764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:21.793764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:21.793764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:21.793764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:21.793764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:21.794281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:21.794281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:21.794281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:21.794281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:21.794281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:21.794281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:21.794281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.794281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:21.795032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.795032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:21.795032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:21.795032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:21.795032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:21.795032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:21.795032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:21.795032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:21.795032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:21.795032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:21.795032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:21.795032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:21.795032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:21.795032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:13:21.795032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:13:21.795032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:21.795521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:21.796144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.796144 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:21.796853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:21.797561 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:21.797996 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:21.798246 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:21.798398 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.799220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:21.799220 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:21.799220 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:21.799220 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:21.799220 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:21.799220 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:21.799220 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.799220 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:21.800930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.800930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:21.800930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:21.800930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:21.800930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:21.800930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:21.800930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:21.800930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:21.800930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:21.800930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:21.800930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:21.800930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:21.800930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:21.800930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:13:21.800930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:21.800930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:21.800930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:21.801467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:26.357614 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:26.359080 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:26.391055 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:26.391374 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.391659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:13:26.391659 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:26.391659 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:26.391659 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:26.391659 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:26.391659 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:26.391659 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.391659 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:26.392432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.392432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:26.392432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:26.392432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:26.392432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:26.392432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:26.392432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:26.392432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:26.392432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:26.392432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:26.392432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:26.392432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:26.392432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:26.392432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:13:26.392432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:26.392432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:26.392432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.393535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:26.781634 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:26.782673 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:26.783181 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:26.783539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.784755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:26.784755 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:26.784755 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:26.784755 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:26.784755 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:26.784755 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:26.784755 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.784755 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:26.786002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.786002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:26.786002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:26.786002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:26.786002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:26.786002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:26.786002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:26.786002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:26.786002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:26.786002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:26.786002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:26.786002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:26.786002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:26.786002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:13:26.786002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:26.786002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:26.786002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.787806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:26.789977 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:26.789977 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:13:26.789977 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:26.789977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.789977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:13:26.789977 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:26.789977 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:26.789977 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:26.789977 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:26.789977 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:26.789977 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.789977 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:26.790633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.790633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:26.790633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:26.790633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:26.790633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:26.790633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:26.790633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:26.790633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:26.790633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:26.790633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:26.790633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:26.790633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:26.790633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:26.790633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:26.790633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:26.792106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:26.792106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:26.792106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:26.792106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:26.792106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:26.792106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:26.792106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:26.792106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.792106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:26.792106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.792106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:26.792106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:26.792106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:26.792106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:26.792106 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:26.793823 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:26.794609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:26.794609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:26.794609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:26.794609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:26.794609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:26.794609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:26.794609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:26.794609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:26.794609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:26.794609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:26.794609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:26.794609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.794609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:26.794609 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:26.794609 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:26.795137 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:26.795137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.795137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:26.795137 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:26.795137 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:26.795137 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:26.795137 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:26.795137 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:26.795137 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.795137 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:26.795137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.795137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:26.795137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:26.795137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:26.795137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:26.795137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:26.795609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:26.795609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:26.795609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:26.795609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:26.795609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:26.795609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:26.795609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:26.795609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:26.795609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:26.795609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:26.795609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:26.795609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:26.795609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:26.795609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:26.795609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:26.795609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:26.796325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.796325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:26.796325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.796325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:26.796325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:26.796325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:26.796325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:26.796325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:26.796325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:26.796325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:26.796325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:26.796325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:26.796325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:26.796325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:26.796325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:26.796325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:26.796792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:26.797341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:26.797341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:26.797341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.797341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:26.797447 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:26.797852 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:26.798115 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:26.798275 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:26.798404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.798789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:26.798789 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:26.798789 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:26.798789 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:26.798789 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:26.798789 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:26.798789 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.798789 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:26.799656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.799656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:26.799656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:26.799656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:26.799656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:26.799656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:26.799656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:26.799656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:26.799656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:26.799656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:26.799656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:26.799656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:26.799656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:26.799656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:13:26.799656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:26.799656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:26.799656 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:26.800188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:31.358360 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:31.361812 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:31.396952 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:31.397366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.398221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:13:31.398221 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:31.398221 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:31.398221 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:31.398221 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:31.398221 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:31.398221 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.398221 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:31.399471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.399471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:31.399471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:31.399471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:31.399471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:31.399471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:31.399471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:31.399471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:31.399471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:31.399471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:31.399471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:31.399471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:31.399471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:31.399471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:13:31.399471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:31.399471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:31.399471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.400421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:31.782267 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:31.783170 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:31.784013 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:31.784013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.784266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:31.784266 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:31.784266 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:31.784266 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:31.784266 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:31.784266 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:31.784266 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.784266 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:31.785304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.785304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:31.785304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:31.785304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:31.785304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:31.785304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:31.785304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:31.785304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:31.785304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:31.785304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:31.785304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:31.785304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:31.785304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:31.785304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:13:31.785304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:31.785304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:31.785304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.786665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:31.787184 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:31.787440 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:13:31.787837 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:31.787992 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.788608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:13:31.788608 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:31.788608 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:31.788608 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:31.788608 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:31.788608 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:31.788608 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.788608 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:31.790478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.790478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:31.790478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:31.790478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:31.790478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:31.790478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:31.790478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:31.790478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:31.790478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:31.790478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:31.790478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:31.790478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:31.790478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:31.790478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:31.790478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:31.790884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:31.790884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:31.790884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:31.790884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:31.790884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:31.790884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:31.790884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:31.790884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.790884 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:31.791766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.791766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:31.791766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:31.791766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:31.791766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:31.791766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:31.791766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:31.791766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:31.791766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:31.791766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:31.791766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:31.791766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:31.791766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:31.791766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:13:31.791766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:13:31.791766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:31.792223 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:31.792710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:31.792710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.792710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:31.792710 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:31.792977 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:31.793639 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:31.794009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.794731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:31.794731 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:31.794731 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:31.794731 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:31.794731 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:31.794731 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:31.794731 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.794731 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:31.796233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.796233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:31.796233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:31.796233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:31.796233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:31.796233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:31.796233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:31.796233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:31.796233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:31.796233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:31.796233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:31.796233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:31.796233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:31.796233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:31.796233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:31.796233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:31.796868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:31.796868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:31.796868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:31.796868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:31.796868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:31.796868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:31.796868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.796868 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:31.799557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.799557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:31.799557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:31.799557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:31.799557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:31.799557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:31.799557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:31.799557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:31.799557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:31.799557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:31.799557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:31.799557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:31.799557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:31.799557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:13:31.799557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:13:31.799557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:31.800214 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:31.801015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.801015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:31.801015 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:31.801015 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:31.801875 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:31.801950 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:31.802263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.803200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:31.803200 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:31.803200 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:31.803200 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:31.803200 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:31.803200 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:31.803200 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.803200 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:31.804243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.804243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:31.804243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:31.804243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:31.804243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:31.804243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:31.804243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:31.804243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:31.804243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:31.804243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:31.804243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:31.804243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:31.804243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:31.804243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:13:31.804243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:31.804243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:31.804243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:31.804620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:36.361787 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:36.362584 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:36.403773 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:36.403969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.404512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:13:36.404512 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:36.404512 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:36.404512 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:36.404512 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:36.404512 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:36.404512 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.404512 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:36.405713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.405713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:36.405713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:36.405713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:36.405713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:36.405713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:36.405713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:36.405713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:36.405713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:36.405713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:36.405713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:36.405713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:36.405713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:36.405713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:13:36.405713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:36.405713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:36.405713 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.406168 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:36.782859 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:36.784302 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:36.784543 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:36.784922 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.785526 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:36.785526 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:36.785526 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:36.785526 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:36.785526 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:36.785526 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:36.785526 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.785526 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:36.787866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.787866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:36.787866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:36.787866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:36.787866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:36.787866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:36.787866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:36.787866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:36.787866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:36.787866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:36.787866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:36.787866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:36.787866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:36.787866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:13:36.787866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:36.787866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:36.787866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.788460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:36.789092 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:36.789092 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:13:36.789449 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:36.789755 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.790660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:13:36.790660 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:36.790660 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:36.790660 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:36.790660 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:36.790660 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:36.790660 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.790660 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:36.792512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.792512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:36.792512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:36.792512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:36.792512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:36.792512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:36.792512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:36.792512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:36.792512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:36.792512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:36.792512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:36.792512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:36.792512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:36.792512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:36.792512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:36.793050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:36.793050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:36.793050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:36.793050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:36.793050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:36.793050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:36.793050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:36.793050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.793050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:36.793050 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:36.794789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.794789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:36.794789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:36.794789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:36.794789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:36.794789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:36.794789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:36.794789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:36.794789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:36.794789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:36.794789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:36.794789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:36.794789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:36.794789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:13:36.794789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:13:36.794789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:36.795290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:36.795799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:36.795799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.795799 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:36.795799 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:36.795928 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:36.796130 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.796718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:36.796718 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:36.796718 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:36.796718 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:36.796718 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:36.796718 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:36.796718 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.796718 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:36.798199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.798199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:36.798199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:36.798199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:36.798199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:36.798199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:36.798199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:36.798199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:36.798199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:36.798199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:36.798199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:36.798199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:36.798199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:36.798199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:36.798199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:36.798199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:36.798702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:36.798702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:36.798702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:36.798702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:36.798702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:36.798702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:36.798702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.798702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:36.800002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.800002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:36.800002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:36.800002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:36.800002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:36.800002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:36.800002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:36.800002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:36.800002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:36.800002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:36.800002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:36.800002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:36.800002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:36.800002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:13:36.800002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:13:36.800002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:36.800493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:36.801019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.801019 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:36.801019 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:36.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:36.801865 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:36.802300 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:36.802537 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.803442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:36.803442 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:36.803442 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:36.803442 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:36.803442 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:36.803442 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:36.803442 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.803442 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:36.805442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.805442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:36.805442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:36.805442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:36.805442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:36.805442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:36.805442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:36.805442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:36.805442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:36.805442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:36.805442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:36.805442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:36.805442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:36.805442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:13:36.805442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:36.805442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:36.805442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:36.805972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:41.361851 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:41.363007 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:41.393101 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:41.393513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.394463 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:13:41.394463 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:41.394463 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:41.394463 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:41.394463 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:41.394463 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:41.394463 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.394463 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:41.395429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.395429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:41.395429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:41.395429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:41.395429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:41.395429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:41.395429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:41.395429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:41.395429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:41.395429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:41.395429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:41.395429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:41.395429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:41.395429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:13:41.395429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:41.395429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:41.395429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.396358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:41.783680 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:41.785331 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:41.786033 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:41.786033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.786853 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:41.786853 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:41.786853 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:41.786853 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:41.786853 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:41.786853 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:41.786853 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.786853 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:41.789219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.789219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:41.789219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:41.789219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:41.789219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:41.789219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:41.789219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:41.789219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:41.789219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:41.789219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:41.789219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:41.789219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:41.789219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:41.789219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:13:41.789219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:41.789219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:41.789219 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.790266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:41.791138 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:41.791138 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:13:41.791138 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:41.791347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.791727 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:13:41.791727 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:41.791727 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:41.791727 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:41.791727 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:41.791727 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:41.791727 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.791727 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:41.792643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.792643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:41.792643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:41.792643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:41.792643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:41.792643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:41.792643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:41.792643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:41.792643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:41.792643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:41.792643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:41.792643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:41.792643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:41.792643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:41.792643 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:41.793169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:41.793169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:41.793169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:41.793169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:41.793169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:41.793169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:41.793169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:41.793169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.793169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:41.793659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.793659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:41.793659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:41.793659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:41.793659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:41.793659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:41.793659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:41.793659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:41.793659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:41.793659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:41.793659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:41.793659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:41.793659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:41.793659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:13:41.793659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:13:41.793659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:41.794156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:41.794666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:41.794666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.794666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:41.794666 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:41.794666 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:41.794666 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:41.794881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.795303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:41.795303 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:41.795303 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:41.795303 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:41.795303 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:41.795303 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:41.795303 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.795303 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:41.796007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.796007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:41.796007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:41.796007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:41.796007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:41.796007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:41.796007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:41.796007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:41.796007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:41.796007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:41.796007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:41.796007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:41.796007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:41.796007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:41.796007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:41.796007 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:41.796453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:41.796453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:41.796453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:41.796453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:41.796453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:41.796453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:41.796453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.796453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:41.796771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.796771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:41.796771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:41.796771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:41.796771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:41.796771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:41.796771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:41.796771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:41.796771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:41.796771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:41.796771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:41.796771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:41.796771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:41.796771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:13:41.796771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:13:41.796771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:41.797268 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:41.797736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.797736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:41.801149 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:41.801587 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:41.801757 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:41.801965 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:41.802141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:41.803715 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:41.804322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:41.804875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:41.804875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:41.804875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:41.804875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:46.362747 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:46.364499 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:46.401522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:46.401904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.402800 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:13:46.402800 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:46.402800 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:46.402800 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:46.402800 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:46.402800 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:46.402800 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.402800 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:46.403793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.403793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:46.403793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:46.403793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:46.403793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:46.403793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:46.403793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:46.403793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:46.403793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:46.403793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:46.403793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:46.403793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:46.403793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:46.403793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:13:46.403793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:46.403793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:46.403793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.404181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:46.784373 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:46.785666 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:46.786099 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:46.788041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.788041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:46.788041 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:46.788041 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:46.788041 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:46.788041 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:46.788041 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:46.788041 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.788041 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:46.788724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.788724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:46.788724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:46.788724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:46.788724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:46.788724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:46.788724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:46.788724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:46.788724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:46.788724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:46.788724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:46.788724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:46.788724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:46.788724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:13:46.788724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:46.788724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:46.788724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.790063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:46.790679 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:46.791309 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:13:46.792119 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:46.792665 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.793342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:13:46.793342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:46.793342 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:46.793342 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:46.793342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:46.793342 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:46.793342 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.793342 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:46.795116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.795116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:46.795116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:46.795116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:46.795116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:46.795116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:46.795116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:46.795116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:46.795116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:46.795116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:46.795116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:46.795116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:46.795116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:46.795116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:46.795116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:46.795697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:46.795697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:46.795697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:46.795697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:46.795697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:46.795697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:46.795697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:46.795697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.795697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:46.798084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.798084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:46.798084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:46.798084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:46.798084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:46.798084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:46.798084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:46.798084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:46.798084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:46.798084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:46.798084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:46.798084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:46.798084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:46.798084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:13:46.798084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:13:46.798084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:46.798617 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:46.799254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:46.799254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.799254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:46.799254 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:46.799254 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:46.799736 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:46.800351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.801325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:46.801325 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:46.801325 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:46.801325 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:46.801325 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:46.801325 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:46.801325 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.801325 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:46.802610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.802610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:46.802610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:46.802610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:46.802610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:46.802610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:46.802610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:46.802610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:46.802610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:46.802610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:46.802610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:46.802610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:46.802610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:46.802610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:46.802610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:46.802610 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:46.803760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:46.803760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:46.803760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:46.803760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:46.803760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:46.803760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:46.803760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.803760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:46.803760 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:46.804257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.804257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:46.804257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:46.804257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:46.804257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:46.804257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:46.804257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:46.804257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:46.804257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:46.804257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:46.804257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:46.804257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:46.804257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:46.804257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:13:46.804257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:13:46.804257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:46.805669 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:46.810083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.810083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:46.810083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:46.810083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:46.810083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:46.810083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.810083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:46.810083 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:46.810083 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:46.810083 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:46.810083 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:46.810083 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:46.810083 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.810083 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:46.810402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.810402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:46.810402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:46.810402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:46.810402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:46.810402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:46.810402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:46.810402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:46.810402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:46.810402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:46.810402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:46.810402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:46.810402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:46.810402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:13:46.810402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:46.810402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:46.810402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:46.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:51.363466 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:51.364710 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:51.410208 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:51.410763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.412015 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:13:51.412015 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:51.412015 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:51.412015 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:51.412015 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:51.412015 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:51.412015 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.412015 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:51.413203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.413203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:51.413203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:51.413203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:51.413203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:51.413203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:51.413203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:51.413203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:51.413203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:51.413203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:51.413203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:51.413203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:51.413203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:51.413203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:13:51.413203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:51.413203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:51.413203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.413969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:51.785093 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:51.786681 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:51.787086 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:51.787418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.788359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:51.788359 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:51.788359 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:51.788359 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:51.788359 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:51.788359 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:51.788359 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.788359 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:51.789912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.789912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:51.789912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:51.789912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:51.789912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:51.789912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:51.789912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:51.789912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:51.789912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:51.789912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:51.789912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:51.789912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:51.789912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:51.789912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:13:51.789912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:51.789912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:51.789912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.790548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:51.791086 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:51.791800 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:13:51.792281 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:51.792527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.793200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:51.793200 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:51.793200 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:51.793200 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:51.793200 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:51.793200 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:51.793200 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.793200 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:51.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:51.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:51.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:51.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:51.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:51.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:51.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:51.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:51.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:51.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:51.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:51.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:51.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:51.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:51.794198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:51.794943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:51.794943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:51.794943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:51.794943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:51.794943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:51.794943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:51.794943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.794943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:51.795456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.795456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:51.795456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:51.795456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:51.795456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:51.795456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:51.795456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:51.795456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:51.795456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:51.795456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:51.795456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:51.795456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:51.795456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:51.795456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:13:51.795456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:13:51.795456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:51.796347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:51.797301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:51.797301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.797301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:51.799031 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:51.799811 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:51.800456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:51.800761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.801534 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:13:51.801534 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:51.801534 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:51.801534 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:51.801534 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:51.801534 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:51.801534 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.801534 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:51.803437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.803437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:51.803437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:51.803437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:51.803437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:51.803437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:51.803437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:51.803437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:51.803437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:51.803437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:51.803437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:51.803437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:51.803437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:51.803437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:51.803437 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:51.804048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:51.804048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:51.804048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:51.804048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:51.804048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:51.804048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:51.804048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:51.804048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.804048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:51.805722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.805722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:51.805722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:51.805722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:51.805722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:51.805722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:51.805722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:51.805722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:51.805722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:51.805722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:51.805722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:51.805722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:51.805722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:51.805722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:13:51.805722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:13:51.805722 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:51.806336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:51.806906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.806906 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:51.806906 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:51.806906 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:51.807096 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:51.807395 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:51.807561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.808208 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:13:51.808208 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:51.808208 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:51.808208 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:51.808208 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:51.808208 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:51.808208 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.808208 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:51.810724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.810724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:51.810724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:51.810724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:51.810724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:51.810724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:51.810724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:51.810724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:51.810724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:51.810724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:51.810724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:51.810724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:51.810724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:51.810724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:13:51.810724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:51.810724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:51.810724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:51.811324 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:56.364288 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:56.365176 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:56.403098 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:56.403596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.404631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:13:56.404631 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:56.404631 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:56.404631 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:56.404631 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:56.404631 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:56.404631 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.404631 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:56.405821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.405821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:56.405821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:56.405821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:56.405821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:56.405821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:56.405821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:56.405821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:56.405821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:56.405821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:56.405821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:56.405821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:56.405821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:56.405821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:13:56.405821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:56.405821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:56.405821 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.406611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:56.785656 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:56.787227 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:56.787685 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:56.788013 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.789774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:56.789774 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:56.789774 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:56.789774 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:56.789774 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:56.789774 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:56.789774 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.789774 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:56.790566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.790566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:56.790566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:56.790566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:56.790566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:56.790566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:56.790566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:56.790566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:56.790566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:56.790566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:56.790566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:56.790566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:56.790566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:56.790566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:13:56.790566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:56.790566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:56.790566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.791269 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:56.791977 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:56.792482 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:13:56.792758 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:56.792921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.793384 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:56.793384 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:56.793384 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:56.793384 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:56.793384 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:56.793384 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:56.793384 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.793384 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:56.794302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.794302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:56.794302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:56.794302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:56.794302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:56.794302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:56.794302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:56.794302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:56.794302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:56.794302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:56.794302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:56.794302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:56.794302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:56.794302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:56.794302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:56.794302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:56.794961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:56.794961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:56.794961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:56.794961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:56.794961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:56.794961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:56.794961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.794961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:56.795347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.795347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:56.795347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:56.795347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:56.795347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:56.795347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:56.795347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:56.795347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:56.795347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:56.795347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:56.795347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:56.795347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:56.795347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:56.795347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:13:56.795347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:13:56.795347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:56.796032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:56.796697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:56.796697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.796697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:56.799458 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:56.799763 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:56.800235 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:56.800590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.801076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:13:56.801076 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:56.801076 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:56.801076 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:56.801076 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:56.801076 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:56.801076 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.801076 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:56.801671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.801671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:13:56.801671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:56.801671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:56.801671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:56.801671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:56.801671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:56.801671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:56.801671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:56.801671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:13:56.801671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:56.801671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:13:56.801671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:56.801671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:13:56.801671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:13:56.801671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:56.802220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:13:56.802220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:56.802220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:13:56.802220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:13:56.802220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:56.802220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:13:56.802220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.802220 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:13:56.802652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.802652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:56.802652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:56.802652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:56.802652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:56.802652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:56.802652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:56.802652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:56.802652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:56.802652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:56.802652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:56.802652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:56.802652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:56.802652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:13:56.802652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:13:56.802652 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:56.803201 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:56.803786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.803786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:13:56.806360 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:13:56.806639 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:13:56.806836 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:56.807029 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:13:56.807159 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.807540 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:13:56.807540 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:56.807540 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:13:56.807540 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:13:56.807540 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:56.807540 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:13:56.807540 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.807540 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:13:56.808423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.808423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:13:56.808423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:13:56.808423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:13:56.808423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:13:56.808423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:13:56.808423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:56.808423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:13:56.808423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:13:56.808423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:13:56.808423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:13:56.808423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:13:56.808423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:13:56.808423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:13:56.808423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:13:56.808423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:56.808423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:13:56.809062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:01.364928 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:01.366149 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:01.397547 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:01.397820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.398709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:14:01.398709 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:01.398709 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:01.398709 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:01.398709 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:01.398709 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:01.398709 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.398709 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:01.399615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.399615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:01.399615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:01.399615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:01.399615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:01.399615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:01.399615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:01.399615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:01.399615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:01.399615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:01.399615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:01.399615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:01.399615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:01.399615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:14:01.399615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:01.399615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:01.399615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.400533 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:01.786319 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:01.787342 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:01.787519 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:01.787883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.788188 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:01.788188 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:01.788188 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:01.788188 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:01.788188 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:01.788188 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:01.788188 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.788188 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:01.789890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.789890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:01.789890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:01.789890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:01.789890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:01.789890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:01.789890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:01.789890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:01.789890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:01.789890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:01.789890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:01.789890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:01.789890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:01.789890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:14:01.789890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:01.789890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:01.789890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.790874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:01.792332 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:01.792786 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:14:01.793234 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:01.793446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.793894 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:01.793894 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:01.793894 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:01.793894 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:01.793894 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:01.793894 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:01.793894 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.793894 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:01.794618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.794618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:01.794618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:01.794618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:01.794618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:01.794618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:01.794618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:01.794618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:01.794618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:01.794618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:01.794618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:01.794618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:01.794618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:01.794618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:01.794618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:01.794618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:01.795777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:01.795777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:01.795777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:01.795777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:01.795777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:01.795777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:01.795777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.795777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:01.795777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.795777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:01.795777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:01.795777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:01.795777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:01.795777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:01.795777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:01.795777 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:01.796776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:01.797520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:01.797520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:01.797520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:01.797520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:01.797520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:01.797520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:01.797520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:01.797520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:01.797520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:01.797520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.797520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:01.799775 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:01.800073 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:01.800364 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:01.800572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.801040 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:01.801040 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:01.801040 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:01.801040 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:01.801040 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:01.801040 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:01.801040 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.801040 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:01.801880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.801880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:01.801880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:01.801880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:01.801880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:01.801880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:01.801880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:01.801880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:01.801880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:01.801880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:01.801880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:01.801880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:01.801880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:01.801880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:01.801880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:01.801880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:01.802344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:01.802344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:01.802344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:01.802344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:01.802344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:01.802344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:01.802344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.802344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:01.802873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.802873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:01.802873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:01.802873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:01.802873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:01.802873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:01.802873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:01.802873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:01.802873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:01.802873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:01.802873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:01.802873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:01.802873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:01.802873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:14:01.802873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:14:01.802873 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:01.803470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:01.804118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.804118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:01.806672 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:01.806962 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:01.807221 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:01.807423 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:01.807551 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.808038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:14:01.808038 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:01.808038 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:01.808038 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:01.808038 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:01.808038 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:01.808038 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.808038 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:01.809004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.809004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:01.809004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:01.809004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:01.809004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:01.809004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:01.809004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:01.809004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:01.809004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:01.809004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:01.809004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:01.809004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:01.809004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:01.809004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:14:01.809004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:01.809004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:01.809004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:01.809512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:06.365699 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:06.367329 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:06.410062 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:06.410326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.411102 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:14:06.411102 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:06.411102 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:06.411102 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:06.411102 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:06.411102 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:06.411102 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.411102 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:06.412129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.412129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:06.412129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:06.412129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:06.412129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:06.412129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:06.412129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:06.412129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:06.412129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:06.412129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:06.412129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:06.412129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:06.412129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:06.412129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:14:06.412129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:06.412129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:06.412129 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.413179 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:06.786956 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:06.788057 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:06.788288 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:06.788436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.789432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:06.789432 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:06.789432 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:06.789432 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:06.789432 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:06.789432 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:06.789432 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.789432 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:06.791253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.791253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:06.791253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:06.791253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:06.791253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:06.791253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:06.791253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:06.791253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:06.791253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:06.791253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:06.791253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:06.791253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:06.791253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:06.791253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:14:06.791253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:06.791253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:06.791253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.792285 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:06.793108 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:06.793108 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:14:06.793309 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:06.793509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.794083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:06.794083 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:06.794083 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:06.794083 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:06.794083 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:06.794083 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:06.794083 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.794083 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:06.794824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.794824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:06.794824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:06.794824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:06.794824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:06.794824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:06.794824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:06.794824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:06.794824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:06.794824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:06.794824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:06.794824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:06.794824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:06.794824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:06.794824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:06.794824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:06.795472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:06.795472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:06.795472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:06.795472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:06.795472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:06.795472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:06.795472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.795472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:06.795788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.795788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:06.795788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:06.795788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:06.795788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:06.795788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:06.795788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:06.795788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:06.795788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:06.795788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:06.795788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:06.795788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:06.795788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:06.795788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:14:06.795788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:14:06.795788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:06.796217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:06.796724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:06.796724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.796724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:06.800076 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:06.800300 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:06.800577 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:06.800801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.801394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:06.801394 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:06.801394 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:06.801394 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:06.801394 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:06.801394 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:06.801394 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.801394 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:06.802126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.802126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:06.802126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:06.802126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:06.802126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:06.802126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:06.802126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:06.802126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:06.802126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:06.802126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:06.802126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:06.802126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:06.802126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:06.802126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:06.802126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:06.802126 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:06.802609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:06.802609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:06.802609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:06.802609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:06.802609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:06.802609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:06.802609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.802609 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:06.803114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.803114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:06.803114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:06.803114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:06.803114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:06.803114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:06.803114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:06.803114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:06.803114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:06.803114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:06.803114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:06.803114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:06.803114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:06.803114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:14:06.803114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:14:06.803114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:06.803584 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:06.804115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.804115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:06.807013 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:06.807467 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:06.807831 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:06.808222 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:06.808462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.809270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:14:06.809270 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:06.809270 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:06.809270 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:06.809270 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:06.809270 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:06.809270 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.809270 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:06.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:06.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:06.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:06.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:06.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:06.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:06.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:06.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:06.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:06.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:06.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:06.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:06.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:14:06.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:06.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:06.810951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:06.811449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:11.366291 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:11.367521 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:11.400928 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:11.401287 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.401997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:14:11.401997 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:11.401997 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:11.401997 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:11.401997 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:11.401997 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:11.401997 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.401997 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:11.402858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.402858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:11.402858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:11.402858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:11.402858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:11.402858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:11.402858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:11.402858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:11.402858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:11.402858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:11.402858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:11.402858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:11.402858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:11.402858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:14:11.402858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:11.402858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:11.402858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.403869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:11.787704 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:11.789005 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:11.789397 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:11.789735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.790666 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:11.790666 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:11.790666 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:11.790666 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:11.790666 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:11.790666 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:11.790666 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.790666 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:11.791905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.791905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:11.791905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:11.791905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:11.791905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:11.791905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:11.791905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:11.791905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:11.791905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:11.791905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:11.791905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:11.791905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:11.791905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:11.791905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:14:11.791905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:11.791905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:11.791905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.793060 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:11.794141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:11.794141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:14:11.794141 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:11.794388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.794971 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:11.794971 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:11.794971 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:11.794971 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:11.794971 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:11.794971 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:11.794971 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.794971 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:11.796419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.796419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:11.796419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:11.796419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:11.796419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:11.796419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:11.796419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:11.796419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:11.796419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:11.796419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:11.796419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:11.796419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:11.796419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:11.796419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:11.796419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:11.796419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:11.797237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:11.797237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:11.797237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:11.797237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:11.797237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:11.797237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:11.797237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.797237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:11.798008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.798008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:11.798008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:11.798008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:11.798008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:11.798008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:11.798008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:11.798008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:11.798008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:11.798008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:11.798008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:11.798008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:11.798008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:11.798008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:14:11.798008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:14:11.798008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:11.798815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:11.799504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:11.799504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.799504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:11.800399 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:11.800667 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:11.801058 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:11.801298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.801858 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:11.801858 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:11.801858 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:11.801858 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:11.801858 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:11.801858 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:11.801858 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.801858 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:11.802745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.802745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:11.802745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:11.802745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:11.802745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:11.802745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:11.802745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:11.802745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:11.802745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:11.802745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:11.802745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:11.802745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:11.802745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:11.802745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:11.802745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:11.802745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:11.803254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:11.803254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:11.803254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:11.803254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:11.803254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:11.803254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:11.803254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.803254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:11.803803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.803803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:11.803803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:11.803803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:11.803803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:11.803803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:11.803803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:11.803803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:11.803803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:11.803803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:11.803803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:11.803803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:11.803803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:11.803803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:14:11.803803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:14:11.803803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:11.804525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:11.805299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.805299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:11.807416 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:11.807687 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:11.808003 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:11.808267 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:11.808413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.809065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:11.809065 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:11.809065 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:11.809065 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:11.809065 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:11.809065 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:11.809065 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.809065 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:11.810280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.810280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:11.810280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:11.810280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:11.810280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:11.810280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:11.810280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:11.810280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:11.810280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:11.810280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:11.810280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:11.810280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:11.810280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:11.810280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:14:11.810280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:11.810280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:11.810280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:11.810774 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:16.367213 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:16.369053 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:16.401899 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:16.402337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.403293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:14:16.403293 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:16.403293 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:16.403293 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:16.403293 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:16.403293 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:16.403293 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.403293 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:16.406524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.406524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:16.406524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:16.406524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:16.406524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:16.406524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:16.406524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:16.406524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:16.406524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:16.406524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:16.406524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:16.406524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:16.406524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:16.406524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:14:16.406524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:16.406524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:16.406524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.407572 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:16.788558 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:16.789473 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:16.789962 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:16.790499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.791575 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:16.791575 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:16.791575 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:16.791575 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:16.791575 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:16.791575 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:16.791575 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.791575 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:16.792748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.792748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:16.792748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:16.792748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:16.792748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:16.792748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:16.792748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:16.792748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:16.792748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:16.792748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:16.792748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:16.792748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:16.792748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:16.792748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:14:16.792748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:16.792748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:16.792748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.793929 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:16.795051 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:16.795051 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:14:16.795051 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:16.795299 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.796011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:16.796011 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:16.796011 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:16.796011 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:16.796011 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:16.796011 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:16.796011 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.796011 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:16.797467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.797467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:16.797467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:16.797467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:16.797467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:16.797467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:16.797467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:16.797467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:16.797467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:16.797467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:16.797467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:16.797467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:16.797467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:16.797467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:16.797467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:16.797467 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:16.797927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:16.797927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:16.797927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:16.797927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:16.797927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:16.797927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:16.797927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.797927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:16.799200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.799200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:16.799200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:16.799200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:16.799200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:16.799200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:16.799200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:16.799200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:16.799200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:16.799200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:16.799200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:16.799200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:16.799200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:16.799200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:14:16.799200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:14:16.799200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:16.799748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:16.800271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:16.800271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.800271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:16.800697 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:16.801227 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:16.801778 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:16.802194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.802897 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:16.802897 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:16.802897 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:16.802897 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:16.802897 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:16.802897 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:16.802897 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.802897 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:16.803763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.803763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:16.803763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:16.803763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:16.803763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:16.803763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:16.803763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:16.803763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:16.803763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:16.803763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:16.803763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:16.803763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:16.803763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:16.803763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:16.803763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:16.803763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:16.804231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:16.804231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:16.804231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:16.804231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:16.804231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:16.804231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:16.804231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.804231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:16.804806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.804806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:16.804806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:16.804806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:16.804806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:16.804806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:16.804806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:16.804806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:16.804806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:16.804806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:16.804806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:16.804806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:16.804806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:16.804806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:14:16.804806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:14:16.804806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:16.805288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:16.805817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.805817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:16.807888 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:16.808537 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:16.809132 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:16.809579 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:16.809970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.810933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:16.810933 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:16.810933 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:16.810933 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:16.810933 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:16.810933 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:16.810933 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.810933 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:16.813041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.813041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:16.813041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:16.813041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:16.813041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:16.813041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:16.813041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:16.813041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:16.813041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:16.813041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:16.813041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:16.813041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:16.813041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:16.813041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:14:16.813041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:16.813041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:16.813041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:16.813621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:21.368321 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:21.370352 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:21.388887 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=234 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:14:21.415251 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:21.415662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.416813 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:14:21.416813 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:21.416813 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:21.416813 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:21.416813 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:21.416813 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:21.416813 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.416813 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:21.417921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.417921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:21.417921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:21.417921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:21.417921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:21.417921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:21.417921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:21.417921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:21.417921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:21.417921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:21.417921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:21.417921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:21.417921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:21.417921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:14:21.417921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:21.417921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:21.417921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.418388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:21.789431 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:21.791327 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:21.791633 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:21.791896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.792875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:21.792875 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:21.792875 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:21.792875 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:21.792875 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:21.792875 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:21.792875 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.792875 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:21.795091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.795091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:21.795091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:21.795091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:21.795091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:21.795091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:21.795091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:21.795091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:21.795091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:21.795091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:21.795091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:21.795091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:21.795091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:21.795091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:14:21.795091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:21.795091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:21.795091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.796169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:21.797093 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:21.797093 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:14:21.797093 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:21.797093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.797434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:21.797434 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:21.797434 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:21.797434 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:21.797434 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:21.797434 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:21.797434 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.797434 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:21.797903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.797903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:21.797903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:21.797903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:21.797903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:21.797903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:21.797903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:21.797903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:21.797903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:21.797903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:21.797903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:21.797903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:21.797903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:21.797903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:21.797903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:21.797903 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:21.798893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:21.798893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:21.798893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:21.798893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:21.798893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:21.798893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:21.798893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.798893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:21.799404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.799404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:21.799404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:21.799404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:21.799404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:21.799404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:21.799404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:21.799404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:21.799404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:21.799404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:21.799404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:21.799404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:21.799404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:21.799404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:14:21.799404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:14:21.799404 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:21.800153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:21.800754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:21.800754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.800754 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:21.801130 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:21.801454 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:21.801788 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:21.802004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.802450 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:21.802450 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:21.802450 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:21.802450 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:21.802450 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:21.802450 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:21.802450 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.802450 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:21.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:21.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:21.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:21.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:21.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:21.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:21.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:21.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:21.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:21.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:21.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:21.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:21.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:21.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:21.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:21.803515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:21.803515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:21.803515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:21.803515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:21.803515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:21.803515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:21.803515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.803515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:21.803747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.803747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:21.803747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:21.803747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:21.803747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:21.803747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:21.803747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:21.803747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:21.803747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:21.803747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:21.803747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:21.803747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:21.803747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:21.803747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:14:21.803747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:14:21.803747 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:21.804423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:21.805050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.805050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:21.808469 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:21.808787 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:21.809040 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:21.809253 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:21.809392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.810056 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:21.810056 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:21.810056 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:21.810056 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:21.810056 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:21.810056 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:21.810056 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.810056 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:21.810717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.810717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:21.810717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:21.810717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:21.810717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:21.810717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:21.810717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:21.810717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:21.810717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:21.810717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:21.810717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:21.810717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:21.810717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:21.810717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:14:21.810717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:21.810717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:21.810717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:21.811156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:26.369112 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:26.370519 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:26.409830 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:26.410348 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.411359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:14:26.411359 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:26.411359 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:26.411359 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:26.411359 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:26.411359 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:26.411359 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.411359 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:26.412547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.412547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:26.412547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:26.412547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:26.412547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:26.412547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:26.412547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:26.412547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:26.412547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:26.412547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:26.412547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:26.412547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:26.412547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:26.412547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:14:26.412547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:26.412547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:26.412547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.413125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:26.790322 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:26.791387 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:26.791778 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:26.792059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.792880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:26.792880 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:26.792880 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:26.792880 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:26.792880 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:26.792880 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:26.792880 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.792880 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:26.794851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.794851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:26.794851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:26.794851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:26.794851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:26.794851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:26.794851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:26.794851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:26.794851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:26.794851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:26.794851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:26.794851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:26.794851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:26.794851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:14:26.794851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:26.794851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:26.794851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.795372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:26.796035 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:26.796279 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:14:26.796673 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:26.796946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.797639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:26.797639 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:26.797639 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:26.797639 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:26.797639 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:26.797639 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:26.797639 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.797639 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:26.798801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.798801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:26.798801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:26.798801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:26.798801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:26.798801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:26.798801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:26.798801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:26.798801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:26.798801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:26.798801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:26.798801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:26.798801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:26.798801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:26.798801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:26.798801 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:26.799309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:26.799309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:26.799309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:26.799309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:26.799309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:26.799309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:26.799309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.799309 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:26.800392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.800392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:26.800392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:26.800392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:26.800392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:26.800392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:26.800392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:26.800392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:26.800392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:26.800392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:26.800392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:26.800392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:26.800392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:26.800392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:14:26.800392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:14:26.800392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:26.800961 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:26.801499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:26.801499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.801499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:26.801499 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:26.801627 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:26.801853 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:26.802092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.802501 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:26.802501 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:26.802501 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:26.802501 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:26.802501 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:26.802501 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:26.802501 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.802501 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:26.803194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.803194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:26.803194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:26.803194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:26.803194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:26.803194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:26.803194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:26.803194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:26.803194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:26.803194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:26.803194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:26.803194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:26.803194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:26.803194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:26.803194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:26.803194 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:26.803622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:26.803622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:26.803622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:26.803622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:26.803622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:26.803622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:26.803622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.803622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:26.804163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.804163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:26.804163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:26.804163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:26.804163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:26.804163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:26.804163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:26.804163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:26.804163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:26.804163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:26.804163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:26.804163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:26.804163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:26.804163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:14:26.804163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:14:26.804163 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:26.804613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:26.805089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.805089 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:26.808840 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:26.809223 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:26.809582 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:26.809948 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:26.810222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.811032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:26.811032 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:26.811032 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:26.811032 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:26.811032 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:26.811032 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:26.811032 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.811032 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:26.812433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.812433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:26.812433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:26.812433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:26.812433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:26.812433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:26.812433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:26.812433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:26.812433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:26.812433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:26.812433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:26.812433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:26.812433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:26.812433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:14:26.812433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:26.812433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:26.812433 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:26.813326 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:31.369753 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:31.371520 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:31.409821 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:31.410295 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.411562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:14:31.411562 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:31.411562 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:31.411562 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:31.411562 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:31.411562 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:31.411562 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.411562 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:31.412784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.412784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:31.412784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:31.412784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:31.412784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:31.412784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:31.412784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:31.412784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:31.412784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:31.412784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:31.412784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:31.412784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:31.412784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:31.412784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:14:31.412784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:31.412784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:31.412784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.413926 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:31.791651 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:31.792784 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:31.793057 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:31.793574 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.794319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:31.794319 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:31.794319 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:31.794319 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:31.794319 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:31.794319 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:31.794319 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.794319 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:31.796394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.796394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:31.796394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:31.796394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:31.796394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:31.796394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:31.796394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:31.796394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:31.796394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:31.796394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:31.796394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:31.796394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:31.796394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:31.796394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:14:31.796394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:31.796394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:31.796394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.797097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:31.797601 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:31.797601 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:14:31.797852 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:31.798379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.799002 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:31.799002 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:31.799002 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:31.799002 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:31.799002 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:31.799002 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:31.799002 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.799002 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:31.799875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.799875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:31.799875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:31.799875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:31.799875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:31.799875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:31.799875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:31.799875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:31.799875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:31.799875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:31.799875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:31.799875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:31.799875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:31.799875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:31.799875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:31.799875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:31.800319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:31.800319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:31.800319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:31.800319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:31.800319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:31.800319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:31.800319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.800319 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:31.800867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.800867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:31.800867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:31.800867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:31.800867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:31.800867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:31.800867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:31.800867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:31.800867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:31.800867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:31.800867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:31.800867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:31.800867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:31.800867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:14:31.800867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:14:31.800867 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:31.801313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:31.801829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:31.801829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.801829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:31.801829 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:31.801945 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:31.802282 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:31.802553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:31.803044 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:31.803044 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:31.803044 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:31.803044 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:31.803044 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:31.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.803044 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:31.803778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.803778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:31.803778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:31.803778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:31.803778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:31.803778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:31.803778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:31.803778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:31.803778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:31.803778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:31.803778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:31.803778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:31.803778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:31.803778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:31.803778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:31.803778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:31.804226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:31.804226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:31.804226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:31.804226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:31.804226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:31.804226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:31.804226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.804226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:31.804784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.804784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:31.804784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:31.804784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:31.804784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:31.804784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:31.804784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:31.804784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:31.804784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:31.804784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:31.804784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:31.804784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:31.804784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:31.804784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:14:31.804784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:14:31.804784 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:31.805261 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:31.805764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.805764 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:31.809224 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:31.809507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:31.809803 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:31.810170 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:31.810244 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.811187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:31.811187 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:31.811187 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:31.811187 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:31.811187 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:31.811187 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:31.811187 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.811187 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:31.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:31.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:31.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:31.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:31.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:31.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:31.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:31.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:31.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:31.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:31.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:31.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:31.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:14:31.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:31.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:31.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:31.813387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:36.370438 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:36.372168 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:36.404090 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:36.404506 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.405518 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:14:36.405518 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:36.405518 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:36.405518 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:36.405518 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:36.405518 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:36.405518 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.405518 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:36.406695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.406695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:36.406695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:36.406695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:36.406695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:36.406695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:36.406695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:36.406695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:36.406695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:36.406695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:36.406695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:36.406695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:36.406695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:36.406695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:14:36.406695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:36.406695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:36.406695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.407282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:36.792443 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:36.793612 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:36.794115 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:36.794115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.795000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:36.795000 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:36.795000 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:36.795000 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:36.795000 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:36.795000 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:36.795000 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.795000 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:36.797076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.797076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:36.797076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:36.797076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:36.797076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:36.797076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:36.797076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:36.797076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:36.797076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:36.797076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:36.797076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:36.797076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:36.797076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:36.797076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:14:36.797076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:36.797076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:36.797076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.798036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:36.798977 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:36.798977 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:14:36.798977 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:36.798977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.799477 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:36.799477 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:36.799477 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:36.799477 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:36.799477 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:36.799477 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:36.799477 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.799477 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:36.801215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.801215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:36.801215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:36.801215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:36.801215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:36.801215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:36.801215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:36.801215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:36.801215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:36.801215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:36.801215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:36.801215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:36.801215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:36.801215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:36.801215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:36.801215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:36.802304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:36.802304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:36.802304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:36.802304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:36.802304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:36.802304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:36.802304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.802304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:36.803413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.803413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:36.803413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:36.803413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:36.803413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:36.803413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:36.803413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:36.803413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:36.803413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:36.803413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:36.803413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:36.803413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:36.803413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:36.803413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:14:36.803413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:14:36.803413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:36.804097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:36.804840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:36.804840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.804840 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:36.804840 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:36.804840 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:36.804840 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:36.805187 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.805641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:36.805641 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:36.805641 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:36.805641 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:36.805641 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:36.805641 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:36.805641 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.805641 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:36.806914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.806914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:36.806914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:36.806914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:36.806914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:36.806914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:36.806914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:36.806914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:36.806914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:36.806914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:36.806914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:36.806914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:36.806914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:36.806914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:36.806914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:36.806914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:36.807651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:36.807651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:36.807651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:36.807651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:36.807651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:36.807651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:36.807651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.807651 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:36.808389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.808389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:36.808389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:36.808389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:36.808389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:36.808389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:36.808389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:36.808389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:36.808389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:36.808389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:36.808389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:36.808389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:36.808389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:36.808389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:14:36.808389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:14:36.808389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:36.809115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:36.809851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.809851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:36.809851 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:36.809851 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:36.810086 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:36.810348 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:36.810485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.810955 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:36.810955 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:36.810955 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:36.810955 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:36.810955 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:36.810955 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:36.810955 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.810955 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:36.812155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.812155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:36.812155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:36.812155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:36.812155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:36.812155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:36.812155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:36.812155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:36.812155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:36.812155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:36.812155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:36.812155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:36.812155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:36.812155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:14:36.812155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:36.812155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:36.812155 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:36.812812 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:41.371209 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:41.372900 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:41.411267 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:41.411524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.412391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:14:41.412391 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:41.412391 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:41.412391 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:41.412391 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:41.412391 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:41.412391 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.412391 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:41.413483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.413483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:41.413483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:41.413483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:41.413483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:41.413483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:41.413483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:41.413483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:41.413483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:41.413483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:41.413483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:41.413483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:41.413483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:41.413483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:14:41.413483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:41.413483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:41.413483 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.414845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:41.793020 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:41.794501 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:41.794866 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:41.795189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.796093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:41.796093 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:41.796093 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:41.796093 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:41.796093 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:41.796093 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:41.796093 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.796093 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:41.797079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.797079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:41.797079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:41.797079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:41.797079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:41.797079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:41.797079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:41.797079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:41.797079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:41.797079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:41.797079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:41.797079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:41.797079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:41.797079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:14:41.797079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:41.797079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:41.797079 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.797707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:41.798219 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:41.798597 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:14:41.799024 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:41.799248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.799781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:41.799781 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:41.799781 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:41.799781 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:41.799781 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:41.799781 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:41.799781 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.799781 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:41.800885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.800885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:41.800885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:41.800885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:41.800885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:41.800885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:41.800885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:41.800885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:41.800885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:41.800885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:41.800885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:41.800885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:41.800885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:41.800885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:41.800885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:41.800885 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:41.801567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:41.801567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:41.801567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:41.801567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:41.801567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:41.801567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:41.801567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.801567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:41.802030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.802030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:41.802030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:41.802030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:41.802030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:41.802030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:41.802030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:41.802030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:41.802030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:41.802030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:41.802030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:41.802030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:41.802030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:41.802030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:14:41.802030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:14:41.802030 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:41.802811 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:41.803529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:41.803529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.803529 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:41.804050 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:41.804387 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:41.804800 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:41.805059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.805731 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:41.805731 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:41.805731 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:41.805731 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:41.805731 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:41.805731 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:41.805731 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.805731 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:41.806968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.806968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:41.806968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:41.806968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:41.806968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:41.806968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:41.806968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:41.806968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:41.806968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:41.806968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:41.806968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:41.806968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:41.806968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:41.806968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:41.806968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:41.806968 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:41.807619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:41.807619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:41.807619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:41.807619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:41.807619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:41.807619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:41.807619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.807619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:41.808245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.808245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:41.808245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:41.808245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:41.808245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:41.808245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:41.808245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:41.808245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:41.808245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:41.808245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:41.808245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:41.808245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:41.808245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:41.808245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:14:41.808245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:14:41.808245 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:41.808893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:41.809570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.809570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:41.809915 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:41.810158 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:41.810511 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:41.810942 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:41.811127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.811604 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:41.811604 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:41.811604 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:41.811604 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:41.811604 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:41.811604 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:41.811604 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.811604 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:41.812586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.812586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:41.812586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:41.812586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:41.812586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:41.812586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:41.812586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:41.812586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:41.812586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:41.812586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:41.812586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:41.812586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:41.812586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:41.812586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:14:41.812586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:41.812586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:41.812586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:41.813127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:46.371973 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:46.373553 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:46.408389 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:46.408794 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.409829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:14:46.409829 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:46.409829 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:46.409829 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:46.409829 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:46.409829 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:46.409829 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.409829 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:46.411255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.411255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:46.411255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:46.411255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:46.411255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:46.411255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:46.411255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:46.411255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:46.411255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:46.411255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:46.411255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:46.411255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:46.411255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:46.411255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:14:46.411255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:46.411255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:46.411255 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.412236 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:46.793721 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:46.795129 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:46.795473 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:46.795744 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.796650 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:46.796650 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:46.796650 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:46.796650 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:46.796650 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:46.796650 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:46.796650 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.796650 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:46.798458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.798458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:46.798458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:46.798458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:46.798458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:46.798458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:46.798458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:46.798458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:46.798458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:46.798458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:46.798458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:46.798458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:46.798458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:46.798458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:14:46.798458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:46.798458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:46.798458 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.799304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:46.800189 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:46.800189 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:14:46.800189 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:46.800189 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.800484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:46.800484 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:46.800484 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:46.800484 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:46.800484 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:46.800484 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:46.800484 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.800484 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:46.801746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.801746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:46.801746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:46.801746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:46.801746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:46.801746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:46.801746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:46.801746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:46.801746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:46.801746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:46.801746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:46.801746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:46.801746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:46.801746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:46.801746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:46.801746 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:46.802631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:46.802631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:46.802631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:46.802631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:46.802631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:46.802631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:46.802631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.802631 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:46.803360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.803360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:46.803360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:46.803360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:46.803360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:46.803360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:46.803360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:46.803360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:46.803360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:46.803360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:46.803360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:46.803360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:46.803360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:46.803360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:14:46.803360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:14:46.803360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:46.803882 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:46.804487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:46.804487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.804487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:46.804487 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:46.804623 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:46.805014 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:46.805400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.806133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:46.806133 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:46.806133 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:46.806133 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:46.806133 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:46.806133 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:46.806133 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.806133 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:46.807005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.807005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:46.807005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:46.807005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:46.807005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:46.807005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:46.807005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:46.807005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:46.807005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:46.807005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:46.807005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:46.807005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:46.807005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:46.807005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:46.807005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:46.807005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:46.807451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:46.807451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:46.807451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:46.807451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:46.807451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:46.807451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:46.807451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.807451 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:46.808328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.808328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:46.808328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:46.808328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:46.808328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:46.808328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:46.808328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:46.808328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:46.808328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:46.808328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:46.808328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:46.808328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:46.808328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:46.808328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:14:46.808328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:14:46.808328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:46.808915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:46.809447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.809447 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:46.810149 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:46.810449 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:46.810805 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:46.811187 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:46.811419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.812162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:46.812162 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:46.812162 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:46.812162 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:46.812162 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:46.812162 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:46.812162 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.812162 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:46.813781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.813781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:46.813781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:46.813781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:46.813781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:46.813781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:46.813781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:46.813781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:46.813781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:46.813781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:46.813781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:46.813781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:46.813781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:46.813781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:14:46.813781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:46.813781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:46.813781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:46.814767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:51.372498 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:51.373602 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:51.406526 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:51.406979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.407891 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:14:51.407891 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:51.407891 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:51.407891 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:51.407891 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:51.407891 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:51.407891 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.407891 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:51.409215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.409215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:51.409215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:51.409215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:51.409215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:51.409215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:51.409215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:51.409215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:51.409215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:51.409215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:51.409215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:51.409215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:51.409215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:51.409215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:14:51.409215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:51.409215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:51.409215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.410184 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:51.794566 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:51.796253 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:51.796561 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:51.796913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.797966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:51.797966 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:51.797966 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:51.797966 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:51.797966 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:51.797966 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:51.797966 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.797966 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:51.799274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.799274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:51.799274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:51.799274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:51.799274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:51.799274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:51.799274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:51.799274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:51.799274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:51.799274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:51.799274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:51.799274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:51.799274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:51.799274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:14:51.799274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:51.799274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:51.799274 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.799765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:51.800278 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:51.800278 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:14:51.800625 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:51.800849 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.801277 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:51.801277 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:51.801277 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:51.801277 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:51.801277 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:51.801277 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:51.801277 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.801277 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:51.802229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.802229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:51.802229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:51.802229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:51.802229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:51.802229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:51.802229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:51.802229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:51.802229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:51.802229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:51.802229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:51.802229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:51.802229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:51.802229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:51.802229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:51.802229 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:51.802767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:51.802767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:51.802767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:51.802767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:51.802767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:51.802767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:51.802767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.802767 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:51.803553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.803553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:51.803553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:51.803553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:51.803553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:51.803553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:51.803553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:51.803553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:51.803553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:51.803553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:51.803553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:51.803553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:51.803553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:51.803553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:14:51.803553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:14:51.803553 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:51.804018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:51.804596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:51.804596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.804596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:51.804679 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:51.805092 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:51.805488 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:51.805852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.806514 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:51.806514 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:51.806514 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:51.806514 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:51.806514 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:51.806514 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:51.806514 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.806514 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:51.807717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.807717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:51.807717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:51.807717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:51.807717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:51.807717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:51.807717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:51.807717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:51.807717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:51.807717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:51.807717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:51.807717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:51.807717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:51.807717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:51.807717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:51.807717 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:51.808183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:51.808183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:51.808183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:51.808183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:51.808183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:51.808183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:51.808183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.808183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:51.809023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.809023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:51.809023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:51.809023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:51.809023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:51.809023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:51.809023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:51.809023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:51.809023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:51.809023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:51.809023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:51.809023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:51.809023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:51.809023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:14:51.809023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:14:51.809023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:51.809520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:51.810024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.810024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:51.810471 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:51.810873 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:51.811198 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:51.811466 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:51.811667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.812195 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:51.812195 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:51.812195 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:51.812195 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:51.812195 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:51.812195 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:51.812195 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.812195 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:51.813462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.813462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:51.813462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:51.813462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:51.813462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:51.813462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:51.813462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:51.813462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:51.813462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:51.813462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:51.813462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:51.813462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:51.813462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:51.813462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:14:51.813462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:51.813462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:51.813462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:51.813952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:56.373287 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:56.375124 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:56.414098 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:56.414505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.415495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:14:56.415495 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:56.415495 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:56.415495 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:56.415495 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:56.415495 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:56.415495 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.415495 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:56.416603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.416603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:56.416603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:56.416603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:56.416603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:56.416603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:56.416603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:56.416603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:56.416603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:56.416603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:56.416603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:56.416603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:56.416603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:56.416603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:14:56.416603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:56.416603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:56.416603 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.417456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:56.795633 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:56.797149 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:56.797405 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:56.797683 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.798732 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:56.798732 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:56.798732 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:56.798732 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:56.798732 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:56.798732 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:56.798732 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.798732 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:56.800121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.800121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:56.800121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:56.800121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:56.800121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:56.800121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:56.800121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:56.800121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:56.800121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:56.800121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:56.800121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:56.800121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:56.800121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:56.800121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:14:56.800121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:56.800121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:56.800121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.801890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:56.803169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:56.803169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:14:56.803169 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:56.803169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.804536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:56.804536 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:56.804536 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:56.804536 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:56.804536 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:56.804536 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:56.804536 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.804536 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:56.806101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.806101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:56.806101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:56.806101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:56.806101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:56.806101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:56.806101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:56.806101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:56.806101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:56.806101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:56.806101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:56.806101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:56.806101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:56.806101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:56.806101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:56.806101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:56.806866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:56.806866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:56.806866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:56.806866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:56.806866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:56.806866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:56.806866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.806866 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:56.806866 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:56.808634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.808634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:56.808634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:56.808634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:56.808634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:56.808634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:56.808634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:56.808634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:56.808634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:56.808634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:56.808634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:56.808634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:56.808634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:56.808634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:14:56.808634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:14:56.808634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:56.809335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:56.810072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:56.810072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.810072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:56.810072 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:56.810072 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:56.810072 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.810709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:56.810709 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:56.810709 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:56.810709 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:56.810709 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:56.810709 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:56.810709 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.810709 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:56.811593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.811593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:14:56.811593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:56.811593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:56.811593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:56.811593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:56.811593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:56.811593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:56.811593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:56.811593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:14:56.811593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:56.811593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:14:56.811593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:56.811593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:14:56.811593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:14:56.811593 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:56.812166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:14:56.812166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:56.812166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:14:56.812166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:14:56.812166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:56.812166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:14:56.812166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.812166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:14:56.812776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.812776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:56.812776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:56.812776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:56.812776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:56.812776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:56.812776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:56.812776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:56.812776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:56.812776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:56.812776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:56.812776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:56.812776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:56.812776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:14:56.812776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:14:56.812776 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:56.813343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:56.813881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.813881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:14:56.813881 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:14:56.813881 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:14:56.814161 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:56.814463 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:14:56.814692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.815670 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:14:56.815670 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:56.815670 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:14:56.815670 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:14:56.815670 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:56.815670 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:14:56.815670 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.815670 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:14:56.817555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.817555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:14:56.817555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:14:56.817555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:14:56.817555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:14:56.817555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:14:56.817555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:56.817555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:14:56.817555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:14:56.817555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:14:56.817555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:14:56.817555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:14:56.817555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:14:56.817555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:14:56.817555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:14:56.817555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:56.817555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:14:56.818097 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:01.374043 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:01.375368 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:01.418106 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:01.418479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.418907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:15:01.418907 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:01.418907 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:01.418907 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:01.418907 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:01.418907 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:01.418907 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.418907 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:01.420074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.420074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:01.420074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:01.420074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:01.420074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:01.420074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:01.420074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:01.420074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:01.420074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:01.420074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:01.420074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:01.420074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:01.420074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:01.420074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:15:01.420074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:01.420074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:01.420074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.420789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:01.796436 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:01.797693 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:01.798016 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:01.798300 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.799134 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:01.799134 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:01.799134 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:01.799134 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:01.799134 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:01.799134 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:01.799134 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.799134 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:01.800859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.800859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:01.800859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:01.800859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:01.800859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:01.800859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:01.800859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:01.800859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:01.800859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:01.800859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:01.800859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:01.800859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:01.800859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:01.800859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:15:01.800859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:01.800859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:01.800859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.801658 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:01.802495 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:01.802495 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:15:01.803196 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:01.803499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.804259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:01.804259 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:01.804259 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:01.804259 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:01.804259 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:01.804259 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:01.804259 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.804259 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:01.805456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.805456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:01.805456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:01.805456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:01.805456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:01.805456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:01.805456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:01.805456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:01.805456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:01.805456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:01.805456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:01.805456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:01.805456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:01.805456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:01.805456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:01.805456 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:01.806023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:01.806023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:01.806023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:01.806023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:01.806023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:01.806023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:01.806023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.806023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:01.807004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.807004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:01.807004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:01.807004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:01.807004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:01.807004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:01.807004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:01.807004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:01.807004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:01.807004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:01.807004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:01.807004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:01.807004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:01.807004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:15:01.807004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:15:01.807004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:01.807485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:01.807972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:01.807972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.807972 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:01.807972 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:01.808400 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:01.809013 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:01.809298 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.809869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:01.809869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:01.809869 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:01.809869 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:01.809869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:01.809869 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:01.809869 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.809869 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:01.811278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.811278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:01.811278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:01.811278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:01.811278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:01.811278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:01.811278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:01.811278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:01.811278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:01.811278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:01.811278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:01.811278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:01.811278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:01.811278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:01.811278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:01.811278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:01.811765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:01.811765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:01.811765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:01.811765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:01.811765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:01.811765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:01.811765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.811765 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:01.812394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.812394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:01.812394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:01.812394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:01.812394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:01.812394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:01.812394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:01.812394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:01.812394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:01.812394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:01.812394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:01.812394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:01.812394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:01.812394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:15:01.812394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:15:01.812394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:01.812875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:01.813418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.813418 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:01.813418 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:01.814098 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:01.814584 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:01.814874 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:01.815066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.815869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:01.815869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:01.815869 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:01.815869 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:01.815869 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:01.815869 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:01.815869 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.815869 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:01.816825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.816825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:01.816825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:01.816825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:01.816825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:01.816825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:01.816825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:01.816825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:01.816825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:01.816825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:01.816825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:01.816825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:01.816825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:01.816825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:15:01.816825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:01.816825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:01.816825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:01.817331 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:06.374552 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:06.376347 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:06.415476 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:06.416039 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.416890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:15:06.416890 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:06.416890 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:06.416890 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:06.416890 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:06.416890 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:06.416890 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.416890 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:06.418096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.418096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:06.418096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:06.418096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:06.418096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:06.418096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:06.418096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:06.418096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:06.418096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:06.418096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:06.418096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:06.418096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:06.418096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:06.418096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:15:06.418096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:06.418096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:06.418096 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.418770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:06.797306 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:06.798646 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:06.798861 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:06.799022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.799701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:06.799701 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:06.799701 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:06.799701 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:06.799701 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:06.799701 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:06.799701 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.799701 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:06.801591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.801591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:06.801591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:06.801591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:06.801591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:06.801591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:06.801591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:06.801591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:06.801591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:06.801591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:06.801591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:06.801591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:06.801591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:06.801591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:15:06.801591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:06.801591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:06.801591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.802197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:06.802835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:06.802835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:15:06.802835 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:06.803018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.803466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:06.803466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:06.803466 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:06.803466 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:06.803466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:06.803466 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:06.803466 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.803466 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:06.804293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.804293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:06.804293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:06.804293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:06.804293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:06.804293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:06.804293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:06.804293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:06.804293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:06.804293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:06.804293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:06.804293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:06.804293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:06.804293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:06.804293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:06.804293 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:06.804904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:06.804904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:06.804904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:06.804904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:06.804904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:06.804904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:06.804904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.804904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:06.805392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.805392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:06.805392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:06.805392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:06.805392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:06.805392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:06.805392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:06.805392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:06.805392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:06.805392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:06.805392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:06.805392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:06.805392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:06.805392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:15:06.805392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:15:06.805392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:06.805907 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:06.806438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:06.806438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.806438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:06.808415 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:06.808888 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:06.809244 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:06.809485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.810108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:06.810108 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:06.810108 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:06.810108 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:06.810108 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:06.810108 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:06.810108 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.810108 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:06.810786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.810786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:06.810786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:06.810786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:06.810786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:06.810786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:06.810786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:06.810786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:06.810786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:06.810786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:06.810786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:06.810786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:06.810786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:06.810786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:06.810786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:06.810786 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:06.811627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:06.811627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:06.811627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:06.811627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:06.811627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:06.811627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:06.811627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.811627 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:06.812123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.812123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:06.812123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:06.812123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:06.812123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:06.812123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:06.812123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:06.812123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:06.812123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:06.812123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:06.812123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:06.812123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:06.812123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:06.812123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:15:06.812123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:15:06.812123 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:06.812950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:06.813829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.813829 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:06.813901 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:06.814392 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:06.814687 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:06.815096 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:06.815344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.815996 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:06.815996 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:06.815996 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:06.815996 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:06.815996 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:06.815996 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:06.815996 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.815996 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:06.816913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.816913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:06.816913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:06.816913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:06.816913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:06.816913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:06.816913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:06.816913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:06.816913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:06.816913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:06.816913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:06.816913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:06.816913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:06.816913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:15:06.816913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:06.816913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:06.816913 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:06.817405 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:11.375157 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:11.376638 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:11.413097 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:11.413402 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.414005 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:15:11.414005 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:11.414005 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:11.414005 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:11.414005 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:11.414005 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:11.414005 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.414005 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:11.414810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.414810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:11.414810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:11.414810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:11.414810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:11.414810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:11.414810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:11.414810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:11.414810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:11.414810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:11.414810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:11.414810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:11.414810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:11.414810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:15:11.414810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:11.414810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:11.414810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.415685 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:11.798032 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:11.799451 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:11.799836 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:11.800292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.801167 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:11.801167 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:11.801167 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:11.801167 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:11.801167 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:11.801167 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:11.801167 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.801167 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:11.802966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.802966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:11.802966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:11.802966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:11.802966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:11.802966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:11.802966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:11.802966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:11.802966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:11.802966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:11.802966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:11.802966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:11.802966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:11.802966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:15:11.802966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:11.802966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:11.802966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.803876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:11.805057 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:11.805057 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:15:11.805057 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:11.805313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.806196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:11.806196 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:11.806196 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:11.806196 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:11.806196 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:11.806196 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:11.806196 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.806196 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:11.807395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.807395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:11.807395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:11.807395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:11.807395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:11.807395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:11.807395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:11.807395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:11.807395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:11.807395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:11.807395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:11.807395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:11.807395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:11.807395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:11.807395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:11.807395 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:11.808457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:11.808457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:11.808457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:11.808457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:11.808457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:11.808457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:11.808457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.808457 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:11.808947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.808947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:11.808947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:11.808947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:11.808947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:11.808947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:11.808947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:11.808947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:11.808947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:11.808947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:11.808947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:11.808947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:11.808947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:11.808947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:15:11.808947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:15:11.808947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:11.809793 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:11.810950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:11.810950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.810950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:11.810950 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:11.810950 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:11.810950 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:11.810950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.810950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:11.810950 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:11.810950 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:11.810950 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:11.810950 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:11.810950 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:11.812048 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.812048 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:11.812048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.812048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:11.812048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:11.812048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:11.812048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:11.812048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:11.812048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:11.812048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:11.812048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:11.812048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:11.812048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:11.812048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:11.812048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:11.812048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:11.812048 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:11.812780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:11.812780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:11.812780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:11.812780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:11.812780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:11.812780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:11.812780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:11.812780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.812780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:11.812780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.812780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:11.812780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:11.812780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:11.812780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:11.812780 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:11.813237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:11.813655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:11.813655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:11.813655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:11.813655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:11.813655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:11.813655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:11.813655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:11.813655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:11.813655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:11.813655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:11.813655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.813655 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:11.814317 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:11.814738 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:11.815070 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:11.815286 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:11.815430 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.815927 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:11.815927 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:11.815927 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:11.815927 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:11.815927 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:11.815927 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:11.815927 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.815927 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:11.818010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.818010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:11.818010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:11.818010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:11.818010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:11.818010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:11.818010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:11.818010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:11.818010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:11.818010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:11.818010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:11.818010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:11.818010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:11.818010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:15:11.818010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:11.818010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:11.818010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:11.818426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:15.798894 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:15.808874 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 07 20:15:15.809082 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=104575) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 07 20:15:15.809183 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Maintenance task: Fixing resource bfbf6c8f-1f7e-474c-a618-4e99355c0282 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:15:15.844642 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, resource={'id': 'bfbf6c8f-1f7e-474c-a618-4e99355c0282', 'name': 'private', 'tenant_id': '47ea4a7c5a154b528631c5537cfdb850', 'project_id': '47ea4a7c5a154b528631c5537cfdb850', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['49f10797-7993-4eac-ad9c-5db13bcf3a17', 'bdd6f685-b77d-459b-b386-e3ef09898997'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:35:01Z', 'updated_at': '2026-04-07T19:35:05Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 39614}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:15.845084 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-bfbf6c8f-1f7e-474c-a618-4e99355c0282, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:15.845645 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-ca0b7fb0-3499-4804-b894-4bb867203f37, external_ids_update=None, columns={'tag': 39614}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:15.845910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:15.846816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Traceback (most recent call last):
Apr 07 20:15:15.846816 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:15.846816 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:15.846816 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:15.846816 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:15.846816 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:15.846816 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:15.846816 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:15.847766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Maintenance task: Failed to fix resource bfbf6c8f-1f7e-474c-a618-4e99355c0282 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:15.847766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:15:15.847766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:15:15.847766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:15:15.847766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:15:15.847766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:15:15.847766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 20:15:15.847766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:15.847766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:15.847766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:15:15.847766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:15.848419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:15.848419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:15.848419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:15:15.848419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:15.848419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:15:15.848419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:15.848419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:15:15.848419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:15:15.848419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:15.848419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:15:15.848419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:15.848419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:15:15.848419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:15:15.848419 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:15.849124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:15:15.849124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:15.849124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:15:15.849124 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Maintenance task: Fixing resource 92857a9a-261a-45c8-bdf2-793e5d5977e1 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:15:15.882220 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, resource={'id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'name': 'public', 'tenant_id': '47ea4a7c5a154b528631c5537cfdb850', 'project_id': '47ea4a7c5a154b528631c5537cfdb850', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['158905cc-b5be-42da-8777-3d7ded042b7c', '6de186a3-9e7c-4950-a1c6-817a37a68984'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-07T19:35:09Z', 'updated_at': '2026-04-07T19:35:17Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:15.882450 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:15.883031 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-783e27a6-53d0-42e0-a778-7125c7a0cff1, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:15.883380 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:15.884291 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Traceback (most recent call last):
Apr 07 20:15:15.884291 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:15.884291 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:15.884291 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:15.884291 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:15.884291 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:15.884291 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:15.884291 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:15.885625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Maintenance task: Failed to fix resource 92857a9a-261a-45c8-bdf2-793e5d5977e1 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:15.885625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:15:15.885625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:15:15.885625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:15:15.885625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:15:15.885625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:15:15.885625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 20:15:15.885625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:15.885625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:15.885625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:15:15.885625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:15.886366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:15.886366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:15.886366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:15:15.886366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:15.886366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:15:15.886366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:15.886366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:15:15.886366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:15:15.886366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:15.886366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:15:15.886366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:15.886366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:15:15.886366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:15:15.886366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:15.887322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:15:15.887322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:15.887322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:15:15.887322 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Maintenance task: Fixing resource 246975ba-4717-4c89-a181-15f0da115b38 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:15:15.916023 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-246975ba-4717-4c89-a181-15f0da115b38, resource={'id': '246975ba-4717-4c89-a181-15f0da115b38', 'name': 'admin_net', 'tenant_id': 'c55e43aaf6164fb7ba8075ffd24bc8d2', 'project_id': 'c55e43aaf6164fb7ba8075ffd24bc8d2', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['4b75275b-2834-446a-a1bf-6e510e154273'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:40:24Z', 'updated_at': '2026-04-07T19:40:25Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 64449}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:15.916507 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-246975ba-4717-4c89-a181-15f0da115b38, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:15.916926 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-f0065b7a-ceb5-4313-9c13-1796e417df18, external_ids_update=None, columns={'tag': 64449}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:15.917142 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:15.917999 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Traceback (most recent call last):
Apr 07 20:15:15.917999 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:15.917999 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:15.917999 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:15.917999 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:15.917999 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:15.917999 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:15.917999 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:15.919008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Maintenance task: Failed to fix resource 246975ba-4717-4c89-a181-15f0da115b38 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:15.919008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:15:15.919008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:15:15.919008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:15:15.919008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:15:15.919008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:15:15.919008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 20:15:15.919008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:15.919008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:15.919008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:15:15.919008 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:15.919329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:15.919329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:15.919329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:15:15.919329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:15.919329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:15:15.919329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:15.919329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:15:15.919329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:15:15.919329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:15.919329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:15:15.919329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:15.919329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:15:15.919329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:15:15.919329 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:15.919692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:15:15.919692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:15.919692 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:15:15.919692 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Maintenance task: Fixing resource 40ad0605-2aac-4da1-b108-03821a0aa715 (type: networks) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:15:15.951913 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-40ad0605-2aac-4da1-b108-03821a0aa715, resource={'id': '40ad0605-2aac-4da1-b108-03821a0aa715', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'tenant_id': '7e48d42664ae4580840a2aef59d52e53', 'project_id': '7e48d42664ae4580840a2aef59d52e53', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['afc68917-6901-4e08-99ad-5c3d8bb8a584'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-07T19:41:05Z', 'updated_at': '2026-04-07T19:41:05Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 12961}, resource_type=networks, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:15.952201 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-40ad0605-2aac-4da1-b108-03821a0aa715, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:15.952590 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-7853e8c0-165f-48a8-8e65-36b87d07f16a, external_ids_update=None, columns={'tag': 12961}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:15.952724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:15.953379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Traceback (most recent call last):
Apr 07 20:15:15.953379 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:15.953379 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:15.953379 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:15.953379 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:15.953379 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:15.953379 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:15.953379 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:15.954355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Maintenance task: Failed to fix resource 40ad0605-2aac-4da1-b108-03821a0aa715 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:15.954355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:15:15.954355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:15:15.954355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:15:15.954355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:15:15.954355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:15:15.954355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 07 20:15:15.954355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:15.954355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:15.954355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:15:15.954355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:15.954924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:15.954924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:15.954924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:15:15.954924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:15.954924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:15:15.954924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:15.954924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:15:15.954924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:15:15.954924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:15.954924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:15:15.954924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:15.954924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:15:15.954924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:15:15.954924 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:15.955707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:15:15.955707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:15.955707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:15:15.955707 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Maintenance task: Fixing resource 6e977c5e-85a0-4398-b359-5ba638de167e (type: routers) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:15:16.028637 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, resource={'id': '6e977c5e-85a0-4398-b359-5ba638de167e', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'project_id': '7e48d42664ae4580840a2aef59d52e53', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'external_fixed_ips': [{'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984', 'ip_address': '172.24.5.89'}, {'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c', 'ip_address': '2001:db8::d'}], 'enable_snat': True}, 'gw_port_id': '7f6e42e8-6279-4fd6-9649-d7b189f6dba8', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-a48jf', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'external_fixed_ips': [{'ip_address': '172.24.5.89', 'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984'}, {'ip_address': '2001:db8::d', 'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-07T19:41:06Z', 'updated_at': '2026-04-07T19:41:09Z', 'revision_number': 3, 'tenant_id': '7e48d42664ae4580840a2aef59d52e53'}, resource_type=routers, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:16.029084 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-a48jf', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:16.029455 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "7f6e42e8-6279-4fd6-9649-d7b189f6dba8"')], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:16.029738 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "7f6e42e8-6279-4fd6-9649-d7b189f6dba8"')], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:16.030041 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.030977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Traceback (most recent call last):
Apr 07 20:15:16.030977 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:16.030977 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:16.030977 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:16.030977 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:16.030977 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:16.030977 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.030977 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:16.031251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Unable to update router 6e977c5e-85a0-4398-b359-5ba638de167e. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.032772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Maintenance task: Failed to fix resource 6e977c5e-85a0-4398-b359-5ba638de167e (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.032772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:15:16.032772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:15:16.032772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:15:16.032772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:15:16.032772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:15:16.032772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 07 20:15:16.032772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 07 20:15:16.032772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 07 20:15:16.032772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 07 20:15:16.032772 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 07 20:15:16.033432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 07 20:15:16.033432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 07 20:15:16.033432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:16.033432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.033432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:15:16.033432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:16.033432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:16.033432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.033432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:15:16.033432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:16.033432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:15:16.033432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:16.033432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:15:16.033432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:15:16.034069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:16.034069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:15:16.034069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:16.034069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:15:16.034069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:15:16.034069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:16.034069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:15:16.034069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.034069 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:15:16.034069 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Maintenance task: Fixing resource 7f6e42e8-6279-4fd6-9649-d7b189f6dba8 (type: router_ports) at create/update {{(pid=104575) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 07 20:15:16.145110 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, resource={'id': '7f6e42e8-6279-4fd6-9649-d7b189f6dba8', 'name': '', 'network_id': '92857a9a-261a-45c8-bdf2-793e5d5977e1', 'project_id': '', 'mac_address': 'fa:16:3e:18:2e:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e977c5e-85a0-4398-b359-5ba638de167e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '6de186a3-9e7c-4950-a1c6-817a37a68984', 'ip_address': '172.24.5.89'}, {'subnet_id': '158905cc-b5be-42da-8777-3d7ded042b7c', 'ip_address': '2001:db8::d'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000164077', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-07T19:41:06Z', 'updated_at': '2026-04-07T19:41:09Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:16.145341 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '6de186a3-9e7c-4950-a1c6-817a37a68984 158905cc-b5be-42da-8777-3d7ded042b7c', 'neutron:network_name': 'neutron-92857a9a-261a-45c8-bdf2-793e5d5977e1', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-6e977c5e-85a0-4398-b359-5ba638de167e'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::d/64', '172.24.5.89/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:16.145604 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=7f6e42e8-6279-4fd6-9649-d7b189f6dba8, lrouter_port=lrp-7f6e42e8-6279-4fd6-9649-d7b189f6dba8, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:16.145851 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.146523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Traceback (most recent call last):
Apr 07 20:15:16.146523 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:16.146523 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:16.146523 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:16.146523 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:16.146523 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:16.146523 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.146523 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:16.147748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Maintenance task: Failed to fix resource 7f6e42e8-6279-4fd6-9649-d7b189f6dba8 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.147748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 07 20:15:16.147748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 07 20:15:16.147748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 07 20:15:16.147748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 07 20:15:16.147748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 07 20:15:16.147748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 07 20:15:16.147748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:16.147748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.147748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:15:16.147748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:16.148149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:16.148149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.148149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 07 20:15:16.148149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:16.148149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 07 20:15:16.148149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:16.148149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 07 20:15:16.148149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 07 20:15:16.148149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:16.148149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 07 20:15:16.148149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:16.148149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 07 20:15:16.148149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 07 20:15:16.148149 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:16.148521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 07 20:15:16.148521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.148521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 07 20:15:16.148521 np0000164077 neutron-ovn-maintenance-worker[104575]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-df002379-fe1a-4920-a0ba-7dcc7fe4fac8 None None] Maintenance task: Synchronization completed (took 0.34 seconds)
Apr 07 20:15:16.375880 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:16.377511 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:16.416128 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:16.416421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.417263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:15:16.417263 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:16.417263 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:16.417263 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:16.417263 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:16.417263 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:16.417263 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.417263 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:16.418602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.418602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:16.418602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:16.418602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:16.418602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:16.418602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:16.418602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:16.418602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:16.418602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:16.418602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:16.418602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:16.418602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:16.418602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:16.418602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:15:16.418602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:16.418602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.418602 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.419479 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:16.798743 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:16.800139 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:16.800825 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:16.800825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.801668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:16.801668 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:16.801668 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:16.801668 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:16.801668 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:16.801668 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:16.801668 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.801668 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:16.803578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.803578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:16.803578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:16.803578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:16.803578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:16.803578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:16.803578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:16.803578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:16.803578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:16.803578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:16.803578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:16.803578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:16.803578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:16.803578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:15:16.803578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:16.803578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.803578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.804718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:16.805702 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:16.805702 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:15:16.805702 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:16.805702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.806321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:16.806321 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:16.806321 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:16.806321 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:16.806321 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:16.806321 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:16.806321 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.806321 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:16.807771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.807771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:16.807771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:16.807771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:16.807771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.807771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:16.807771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:16.807771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:16.807771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.807771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:16.807771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:16.807771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:16.807771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:16.807771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:16.807771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:16.807771 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:16.808761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:16.808761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:16.808761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:16.808761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:16.808761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:16.808761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:16.808761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.808761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:16.809432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.809432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:16.809432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:16.809432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:16.809432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:16.809432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:16.809432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:16.809432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:16.809432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:16.809432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:16.809432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:16.809432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:16.809432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:16.809432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:15:16.809432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:15:16.809432 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:16.810472 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:16.811032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:16.811032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.811032 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:16.811032 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:16.811032 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:16.811032 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:16.811264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.811896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:16.811896 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:16.811896 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:16.811896 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:16.811896 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:16.811896 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:16.811896 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.811896 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:16.812807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.812807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:16.812807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:16.812807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:16.812807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.812807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:16.812807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:16.812807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:16.812807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.812807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:16.812807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:16.812807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:16.812807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:16.812807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:16.812807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:16.812807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:16.813262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:16.813262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:16.813262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:16.813262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:16.813262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:16.813262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:16.813262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.813262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:16.814133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.814133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:16.814133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:16.814133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:16.814133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:16.814133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:16.814133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:16.814133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:16.814133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:16.814133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:16.814133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:16.814133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:16.814133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:16.814133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:15:16.814133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:15:16.814133 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:16.814748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:16.815460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.815460 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:16.815460 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:16.815460 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:16.815616 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:16.815757 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:16.815896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.816417 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:15:16.816417 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:16.816417 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:16.816417 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:16.816417 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:16.816417 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:16.816417 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.816417 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:16.817608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.817608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:16.817608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:16.817608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:16.817608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:16.817608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:16.817608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:16.817608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:16.817608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:16.817608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:16.817608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:16.817608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:16.817608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:16.817608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:15:16.817608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:16.817608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.817608 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:16.818152 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:21.377037 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:21.379193 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:21.397558 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=435 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:15:21.420068 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:21.420209 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.420998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:15:21.420998 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:21.420998 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:21.420998 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:21.420998 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:21.420998 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:21.420998 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.420998 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:21.421904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.421904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:21.421904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:21.421904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:21.421904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:21.421904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:21.421904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:21.421904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:21.421904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:21.421904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:21.421904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:21.421904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:21.421904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:21.421904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:15:21.421904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:21.421904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:21.421904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.422282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:21.799715 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:21.801499 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:21.802097 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:21.802492 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.803557 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:21.803557 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:21.803557 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:21.803557 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:21.803557 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:21.803557 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:21.803557 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.803557 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:21.805729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.805729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:21.805729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:21.805729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:21.805729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:21.805729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:21.805729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:21.805729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:21.805729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:21.805729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:21.805729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:21.805729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:21.805729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:21.805729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:15:21.805729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:21.805729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:21.805729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.806580 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:21.807475 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:21.807475 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:15:21.807741 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:21.808238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.809157 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:21.809157 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:21.809157 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:21.809157 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:21.809157 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:21.809157 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:21.809157 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.809157 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:21.810653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.810653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:21.810653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:21.810653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:21.810653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:21.810653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:21.810653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:21.810653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:21.810653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:21.810653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:21.810653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:21.810653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:21.810653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:21.810653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:21.810653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:21.810653 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:21.811137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:21.811137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:21.811137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:21.811137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:21.811137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:21.811137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:21.811137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.811137 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:21.811137 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:21.813205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.813205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:21.813205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:21.813205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:21.813205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:21.813205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:21.813205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:21.813205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:21.813205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:21.813205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:21.813205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:21.813205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:21.813205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:21.813205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:15:21.813205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:15:21.813205 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:21.813687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:21.814260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:21.814260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.814260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:21.814260 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:21.814260 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:21.814260 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.814825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:21.814825 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:21.814825 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:21.814825 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:21.814825 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:21.814825 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:21.814825 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.814825 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:21.816709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.816709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:21.816709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:21.816709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:21.816709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:21.816709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:21.816709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:21.816709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:21.816709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:21.816709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:21.816709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:21.816709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:21.816709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:21.816709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:21.816709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:21.816709 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:21.817802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:21.817802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:21.817802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:21.817802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:21.817802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:21.817802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:21.817802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.817802 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:21.817802 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:21.819734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.819734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:21.819734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:21.819734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:21.819734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:21.819734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:21.819734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:21.819734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:21.819734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:21.819734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:21.819734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:21.819734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:21.819734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:21.819734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:15:21.819734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:15:21.819734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:21.820911 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:21.822254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.822254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:21.822254 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:21.822254 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:21.822254 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:21.822254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.822254 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:15:21.822254 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:21.822254 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:21.822254 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:21.822254 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:21.822254 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:21.823199 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.823199 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:21.824305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.824305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:21.824305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:21.824305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:21.824305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:21.824305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:21.824305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:21.824305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:21.824305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:21.824305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:21.824305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:21.824305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:21.824305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:21.824305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:15:21.824305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:21.824305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:21.824305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:21.825248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:26.377850 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:26.379659 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:26.417741 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:26.418583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.419325 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:15:26.419325 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:26.419325 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:26.419325 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:26.419325 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:26.419325 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:26.419325 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.419325 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:26.420436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.420436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:26.420436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:26.420436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:26.420436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:26.420436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:26.420436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:26.420436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:26.420436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:26.420436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:26.420436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:26.420436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:26.420436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:26.420436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:15:26.420436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:26.420436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:26.420436 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.421519 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:26.800451 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:26.801767 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:26.802153 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:26.802441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.803544 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:26.803544 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:26.803544 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:26.803544 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:26.803544 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:26.803544 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:26.803544 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.803544 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:26.805667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.805667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:26.805667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:26.805667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:26.805667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:26.805667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:26.805667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:26.805667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:26.805667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:26.805667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:26.805667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:26.805667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:26.805667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:26.805667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:15:26.805667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:26.805667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:26.805667 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.807010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:26.808521 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:26.808521 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:15:26.808521 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:26.808521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.809049 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:26.809049 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:26.809049 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:26.809049 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:26.809049 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:26.809049 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:26.809049 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.809049 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:26.810290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.810290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:26.810290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:26.810290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:26.810290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:26.810290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:26.810290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:26.810290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:26.810290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:26.810290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:26.810290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:26.810290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:26.810290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:26.810290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:26.810290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:26.810290 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:26.811511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:26.811511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:26.811511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:26.811511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:26.811511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:26.811511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:26.811511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.811511 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:26.812154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.812154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:26.812154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:26.812154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:26.812154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:26.812154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:26.812154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:26.812154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:26.812154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:26.812154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:26.812154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:26.812154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:26.812154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:26.812154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:15:26.812154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:15:26.812154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:26.812638 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:26.813301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:26.813301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.813301 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:26.813301 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:26.813301 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:26.813802 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:26.814227 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.815003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:26.815003 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:26.815003 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:26.815003 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:26.815003 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:26.815003 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:26.815003 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.815003 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:26.815969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.815969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:26.815969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:26.815969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:26.815969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:26.815969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:26.815969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:26.815969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:26.815969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:26.815969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:26.815969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:26.815969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:26.815969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:26.815969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:26.815969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:26.815969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:26.816763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:26.816763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:26.816763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:26.816763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:26.816763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:26.816763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:26.816763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.816763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:26.817400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.817400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:26.817400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:26.817400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:26.817400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:26.817400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:26.817400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:26.817400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:26.817400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:26.817400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:26.817400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:26.817400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:26.817400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:26.817400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:15:26.817400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:15:26.817400 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:26.817842 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:26.818347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.818347 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:26.818347 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:26.818347 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:26.818703 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:26.818943 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:26.819116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.819798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:15:26.819798 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:26.819798 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:26.819798 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:26.819798 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:26.819798 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:26.819798 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.819798 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:26.822160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.822160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:26.822160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:26.822160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:26.822160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:26.822160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:26.822160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:26.822160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:26.822160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:26.822160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:26.822160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:26.822160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:26.822160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:26.822160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:15:26.822160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:26.822160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:26.822160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:26.822702 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:31.379503 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:31.381263 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:31.413822 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:31.414033 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.414646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:15:31.414646 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:31.414646 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:31.414646 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:31.414646 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:31.414646 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:31.414646 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.414646 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:31.415791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.415791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:31.415791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:31.415791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:31.415791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:31.415791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:31.415791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:31.415791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:31.415791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:31.415791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:31.415791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:31.415791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:31.415791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:31.415791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:15:31.415791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:31.415791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:31.415791 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.416902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:31.801195 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:31.802587 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:31.803024 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:31.803264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.804262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:31.804262 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:31.804262 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:31.804262 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:31.804262 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:31.804262 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:31.804262 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.804262 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:31.806067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.806067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:31.806067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:31.806067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:31.806067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:31.806067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:31.806067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:31.806067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:31.806067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:31.806067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:31.806067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:31.806067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:31.806067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:31.806067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:15:31.806067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:31.806067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:31.806067 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.807028 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:31.807823 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:31.808106 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:15:31.808674 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:31.809017 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.809824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:31.809824 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:31.809824 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:31.809824 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:31.809824 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:31.809824 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:31.809824 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.809824 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:31.811207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.811207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:31.811207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:31.811207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:31.811207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:31.811207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:31.811207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:31.811207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:31.811207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:31.811207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:31.811207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:31.811207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:31.811207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:31.811207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:31.811207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:31.811207 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:31.812442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:31.812442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:31.812442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:31.812442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:31.812442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:31.812442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:31.812442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.812442 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:31.813147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.813147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:31.813147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:31.813147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:31.813147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:31.813147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:31.813147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:31.813147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:31.813147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:31.813147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:31.813147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:31.813147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:31.813147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:31.813147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:15:31.813147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:15:31.813147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:31.814124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:31.814697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:31.814697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.814697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:31.814697 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:31.814697 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:31.814697 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:31.814697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.814943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:31.814943 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:31.814943 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:31.814943 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:31.814943 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:31.814943 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:31.814943 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.814943 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:31.815734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.815734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:31.815734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:31.815734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:31.815734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:31.815734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:31.815734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:31.815734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:31.815734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:31.815734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:31.815734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:31.815734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:31.815734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:31.815734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:31.815734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:31.815734 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:31.816373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:31.816373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:31.816373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:31.816373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:31.816373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:31.816373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:31.816373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.816373 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:31.817389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.817389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:31.817389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:31.817389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:31.817389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:31.817389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:31.817389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:31.817389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:31.817389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:31.817389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:31.817389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:31.817389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:31.817389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:31.817389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:15:31.817389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:15:31.817389 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:31.817896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:31.818585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.818585 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:31.818585 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:31.818766 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:31.819149 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:31.819369 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:31.819513 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.820120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:15:31.820120 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:31.820120 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:31.820120 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:31.820120 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:31.820120 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:31.820120 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.820120 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:31.821839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.821839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:31.821839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:31.821839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:31.821839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:31.821839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:31.821839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:31.821839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:31.821839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:31.821839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:31.821839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:31.821839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:31.821839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:31.821839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:15:31.821839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:31.821839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:31.821839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:31.822531 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:36.380599 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:36.382077 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:36.417010 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:36.417231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.418266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Traceback (most recent call last):
Apr 07 20:15:36.418266 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:36.418266 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:36.418266 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:36.418266 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:36.418266 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:36.418266 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.418266 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:36.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-5b052af6-fe0e-4b58-bc40-1106485228b0 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:36.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:36.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:36.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:36.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:36.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:36.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:36.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:36.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:36.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:36.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:36.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:36.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:15:36.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:36.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:36.419431 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.420337 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:36.802248 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:36.804241 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:36.804581 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:36.804830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.806103 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:36.806103 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:36.806103 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:36.806103 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:36.806103 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:36.806103 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:36.806103 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.806103 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:36.808119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.808119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:36.808119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:36.808119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:36.808119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:36.808119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:36.808119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:36.808119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:36.808119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:36.808119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:36.808119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:36.808119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:36.808119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:36.808119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:15:36.808119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:36.808119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:36.808119 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.808862 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:36.809685 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:36.809685 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:15:36.809797 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:36.809954 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.810589 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:36.810589 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:36.810589 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:36.810589 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:36.810589 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:36.810589 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:36.810589 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.810589 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:36.811725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.811725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:36.811725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:36.811725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:36.811725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:36.811725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:36.811725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:36.811725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:36.811725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:36.811725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:36.811725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:36.811725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:36.811725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:36.811725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:36.811725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:36.811725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:36.812204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:36.812204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:36.812204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:36.812204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:36.812204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:36.812204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:36.812204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.812204 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:36.813101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.813101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:36.813101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:36.813101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:36.813101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:36.813101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:36.813101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:36.813101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:36.813101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:36.813101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:36.813101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:36.813101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:36.813101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:36.813101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:15:36.813101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:15:36.813101 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:36.813561 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:36.814559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:36.814559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.814559 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:36.814559 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:36.814559 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:36.814731 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:36.814855 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.815498 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:36.815498 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:36.815498 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:36.815498 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:36.815498 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:36.815498 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:36.815498 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.815498 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:36.816864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.816864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:36.816864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:36.816864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:36.816864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:36.816864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:36.816864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:36.816864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:36.816864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:36.816864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:36.816864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:36.816864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:36.816864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:36.816864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:36.816864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:36.816864 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:36.817344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:36.817344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:36.817344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:36.817344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:36.817344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:36.817344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:36.817344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.817344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:36.818478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.818478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:36.818478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:36.818478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:36.818478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:36.818478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:36.818478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:36.818478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:36.818478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:36.818478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:36.818478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:36.818478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:36.818478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:36.818478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:15:36.818478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:15:36.818478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:36.818978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:36.819590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.819590 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:36.819590 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:36.819590 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:36.820117 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:36.820477 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:36.820707 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.821554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:15:36.821554 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:36.821554 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:36.821554 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:36.821554 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:36.821554 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:36.821554 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.821554 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:36.822712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.822712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:36.822712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:36.822712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:36.822712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:36.822712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:36.822712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:36.822712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:36.822712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:36.822712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:36.822712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:36.822712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:36.822712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:36.822712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:15:36.822712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:36.822712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:36.822712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:36.823217 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:41.381562 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:41.383611 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:41.419300 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:41.419705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.420845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:15:41.420845 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:41.420845 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:41.420845 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:41.420845 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:41.420845 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:41.420845 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.420845 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:41.422221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.422221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:41.422221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:41.422221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:41.422221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:41.422221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:41.422221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:41.422221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:41.422221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:41.422221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:41.422221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:41.422221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:41.422221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:41.422221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:15:41.422221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:41.422221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:41.422221 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.423042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:41.803331 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:41.804937 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:41.805402 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:41.805701 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.806668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:41.806668 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:41.806668 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:41.806668 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:41.806668 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:41.806668 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:41.806668 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.806668 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:41.808461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.808461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:41.808461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:41.808461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:41.808461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:41.808461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:41.808461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:41.808461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:41.808461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:41.808461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:41.808461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:41.808461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:41.808461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:41.808461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:15:41.808461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:41.808461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:41.808461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.809396 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:41.810366 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:41.810366 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:15:41.810518 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:41.810760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.811510 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:41.811510 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:41.811510 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:41.811510 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:41.811510 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:41.811510 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:41.811510 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.811510 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:41.812967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.812967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:41.812967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:41.812967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:41.812967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:41.812967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:41.812967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:41.812967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:41.812967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:41.812967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:41.812967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:41.812967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:41.812967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:41.812967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:41.812967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:41.812967 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:41.813948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:41.813948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:41.813948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:41.813948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:41.813948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:41.813948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:41.813948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.813948 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:41.814814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.814814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:41.814814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:41.814814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:41.814814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:41.814814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:41.814814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:41.814814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:41.814814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:41.814814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:41.814814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:41.814814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:41.814814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:41.814814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:15:41.814814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:15:41.814814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:41.815657 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:41.816594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:41.816594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.816594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:41.816594 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:41.816594 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:41.816594 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:41.816594 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.817076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:41.817076 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:41.817076 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:41.817076 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:41.817076 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:41.817076 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:41.817076 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.817076 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:41.817736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.817736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:41.817736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:41.817736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:41.817736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:41.817736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:41.817736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:41.817736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:41.817736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:41.817736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:41.817736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:41.817736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:41.817736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:41.817736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:41.817736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:41.817736 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:41.818392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:41.818392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:41.818392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:41.818392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:41.818392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:41.818392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:41.818392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.818392 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:41.818904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.818904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:41.818904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:41.818904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:41.818904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:41.818904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:41.818904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:41.818904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:41.818904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:41.818904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:41.818904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:41.818904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:41.818904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:41.818904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:15:41.818904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:15:41.818904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:41.819443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:41.819974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.819974 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:41.819974 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:41.819974 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:41.820250 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:41.820472 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:41.820619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.821154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:15:41.821154 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:41.821154 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:41.821154 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:41.821154 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:41.821154 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:41.821154 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.821154 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:41.822172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.822172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:41.822172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:41.822172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:41.822172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:41.822172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:41.822172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:41.822172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:41.822172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:41.822172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:41.822172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:41.822172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:41.822172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:41.822172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:15:41.822172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:41.822172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:41.822172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:41.822673 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:46.382406 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:46.384331 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:46.415832 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:46.416415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.417162 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:15:46.417162 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:46.417162 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:46.417162 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:46.417162 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:46.417162 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:46.417162 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.417162 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:46.418059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.418059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:46.418059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:46.418059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:46.418059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:46.418059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:46.418059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:46.418059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:46.418059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:46.418059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:46.418059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:46.418059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:46.418059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:46.418059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:15:46.418059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:46.418059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:46.418059 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.419052 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:46.804261 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:46.805695 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:46.805893 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:46.806080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.806921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:46.806921 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:46.806921 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:46.806921 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:46.806921 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:46.806921 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:46.806921 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.806921 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:46.809364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.809364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:46.809364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:46.809364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:46.809364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:46.809364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:46.809364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:46.809364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:46.809364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:46.809364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:46.809364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:46.809364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:46.809364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:46.809364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:15:46.809364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:46.809364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:46.809364 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.810284 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:46.811321 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:46.811321 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:15:46.811321 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:46.811321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.812292 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:46.812292 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:46.812292 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:46.812292 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:46.812292 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:46.812292 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:46.812292 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.812292 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:46.813145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.813145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:46.813145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:46.813145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:46.813145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:46.813145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:46.813145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:46.813145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:46.813145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:46.813145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:46.813145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:46.813145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:46.813145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:46.813145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:46.813145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:46.813145 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:46.813916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:46.813916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:46.813916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:46.813916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:46.813916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:46.813916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:46.813916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.813916 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:46.814377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.814377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:46.814377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:46.814377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:46.814377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:46.814377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:46.814377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:46.814377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:46.814377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:46.814377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:46.814377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:46.814377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:46.814377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:46.814377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:15:46.814377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:15:46.814377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:46.814893 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:46.815426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:46.815426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.815426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:46.815585 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:46.815864 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:46.816433 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:46.816724 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.817270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:46.817270 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:46.817270 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:46.817270 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:46.817270 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:46.817270 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:46.817270 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.817270 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:46.818050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.818050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:46.818050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:46.818050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:46.818050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:46.818050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:46.818050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:46.818050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:46.818050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:46.818050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:46.818050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:46.818050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:46.818050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:46.818050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:46.818050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:46.818050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:46.818579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:46.818579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:46.818579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:46.818579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:46.818579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:46.818579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:46.818579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.818579 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:46.818807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.818807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:46.818807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:46.818807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:46.818807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:46.818807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:46.818807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:46.818807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:46.818807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:46.818807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:46.818807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:46.818807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:46.818807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:46.818807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:15:46.818807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:15:46.818807 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:46.819323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:46.819852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.819852 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:46.819852 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:46.820181 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:46.820502 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:46.820748 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:46.820898 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.821379 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:15:46.821379 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:46.821379 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:46.821379 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:46.821379 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:46.821379 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:46.821379 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.821379 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:46.822327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.822327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:46.822327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:46.822327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:46.822327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:46.822327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:46.822327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:46.822327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:46.822327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:46.822327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:46.822327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:46.822327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:46.822327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:46.822327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:15:46.822327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:46.822327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:46.822327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:46.822816 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:51.383081 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:51.384034 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:51.420763 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:51.421114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.421997 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:15:51.421997 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:51.421997 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:51.421997 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:51.421997 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:51.421997 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:51.421997 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.421997 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:51.423233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.423233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:51.423233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:51.423233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:51.423233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:51.423233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:51.423233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:51.423233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:51.423233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:51.423233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:51.423233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:51.423233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:51.423233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:51.423233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:15:51.423233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:51.423233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:51.423233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.423883 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:51.805052 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:51.806564 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:51.806847 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:51.807141 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.807902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:51.807902 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:51.807902 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:51.807902 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:51.807902 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:51.807902 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:51.807902 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.807902 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:51.809527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.809527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:51.809527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:51.809527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:51.809527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:51.809527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:51.809527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:51.809527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:51.809527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:51.809527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:51.809527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:51.809527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:51.809527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:51.809527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:15:51.809527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:51.809527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:51.809527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.810728 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:51.811848 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:51.811848 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:15:51.811848 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:51.811848 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.812596 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:51.812596 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:51.812596 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:51.812596 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:51.812596 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:51.812596 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:51.812596 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.812596 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:51.814183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.814183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:51.814183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:51.814183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:51.814183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:51.814183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:51.814183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:51.814183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:51.814183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:51.814183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:51.814183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:51.814183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:51.814183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:51.814183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:51.814183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:51.814183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:51.814824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:51.814824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:51.814824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:51.814824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:51.814824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:51.814824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:51.814824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.814824 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:51.816215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.816215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:51.816215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:51.816215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:51.816215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:51.816215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:51.816215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:51.816215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:51.816215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:51.816215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:51.816215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:51.816215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:51.816215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:51.816215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:15:51.816215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:15:51.816215 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:51.816706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:51.817351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:51.817351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.817351 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:51.817351 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:51.817351 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:51.817351 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:51.817625 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.817959 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:51.817959 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:51.817959 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:51.817959 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:51.817959 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:51.817959 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:51.817959 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.817959 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:51.818789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.818789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:51.818789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:51.818789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:51.818789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:51.818789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:51.818789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:51.818789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:51.818789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:51.818789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:51.818789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:51.818789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:51.818789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:51.818789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:51.818789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:51.818789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:51.819249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:51.819249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:51.819249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:51.819249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:51.819249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:51.819249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:51.819249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.819249 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:51.819896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.819896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:51.819896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:51.819896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:51.819896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:51.819896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:51.819896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:51.819896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:51.819896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:51.819896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:51.819896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:51.819896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:51.819896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:51.819896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:15:51.819896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:15:51.819896 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:51.820382 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:51.820936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.820936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:51.820936 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:51.820936 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:51.821178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:51.821400 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:51.821548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.822313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:15:51.822313 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:51.822313 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:51.822313 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:51.822313 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:51.822313 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:51.822313 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.822313 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:51.824350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.824350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:51.824350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:51.824350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:51.824350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:51.824350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:51.824350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:51.824350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:51.824350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:51.824350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:51.824350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:51.824350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:51.824350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:51.824350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:15:51.824350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:51.824350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:51.824350 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:51.824831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:56.383836 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:56.385403 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:56.420864 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:56.421294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.422062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:15:56.422062 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:56.422062 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:56.422062 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:56.422062 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:56.422062 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:56.422062 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.422062 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:56.422943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.422943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:56.422943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:56.422943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:56.422943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:56.422943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:56.422943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:56.422943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:56.422943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:56.422943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:56.422943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:56.422943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:56.422943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:56.422943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:15:56.422943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:56.422943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:56.422943 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.423869 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:56.805975 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:56.807586 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:56.807937 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:56.808114 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.809313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:56.809313 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:56.809313 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:56.809313 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:56.809313 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:56.809313 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:56.809313 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.809313 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:56.811173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.811173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:56.811173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:56.811173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:56.811173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:56.811173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:56.811173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:56.811173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:56.811173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:56.811173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:56.811173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:56.811173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:56.811173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:56.811173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:15:56.811173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:56.811173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:56.811173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.812095 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:56.813126 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:56.813126 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:15:56.813126 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:56.813294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.813923 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:56.813923 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:56.813923 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:56.813923 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:56.813923 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:56.813923 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:56.813923 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.813923 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:56.815012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.815012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:56.815012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:56.815012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:56.815012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:56.815012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:56.815012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:56.815012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:56.815012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:56.815012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:56.815012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:56.815012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:56.815012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:56.815012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:56.815012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:56.815012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:56.815845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:56.815845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:56.815845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:56.815845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:56.815845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:56.815845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:56.815845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.815845 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:56.816164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.816164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:56.816164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:56.816164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:56.816164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:56.816164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:56.816164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:56.816164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:56.816164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:56.816164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:56.816164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:56.816164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:56.816164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:56.816164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:15:56.816164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:15:56.816164 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:56.816705 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:56.817366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:56.817366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.817366 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:56.817688 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:56.818126 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:56.818798 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:56.819622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.820077 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:56.820077 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:56.820077 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:56.820077 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:56.820077 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:56.820077 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:56.820077 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.820077 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:56.821541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.821541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:15:56.821541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:56.821541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:56.821541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:56.821541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:56.821541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:56.821541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:56.821541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:56.821541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:15:56.821541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:56.821541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:15:56.821541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:56.821541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:15:56.821541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:15:56.821541 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:56.822115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:15:56.822115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:56.822115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:15:56.822115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:15:56.822115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:56.822115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:15:56.822115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.822115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:15:56.822115 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:15:56.823978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.823978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:56.823978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:56.823978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:56.823978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:56.823978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:56.823978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:56.823978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:56.823978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:56.823978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:56.823978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:56.823978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:56.823978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:56.823978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:15:56.823978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:15:56.823978 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:56.824495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:56.825058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.825058 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:15:56.825058 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:15:56.825058 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:56.825318 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:15:56.825474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.826111 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:15:56.826111 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:56.826111 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:15:56.826111 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:15:56.826111 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:56.826111 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:15:56.826111 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.826111 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:15:56.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:15:56.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:15:56.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:15:56.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:15:56.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:15:56.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:56.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:15:56.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:15:56.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:15:56.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:15:56.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:15:56.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:15:56.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:15:56.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:15:56.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:56.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:15:56.828710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:01.384353 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:01.385763 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:01.426941 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:01.427478 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.428147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:16:01.428147 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:01.428147 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:01.428147 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:01.428147 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:01.428147 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:01.428147 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.428147 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:01.429357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.429357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:01.429357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:01.429357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:01.429357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:01.429357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:01.429357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:01.429357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:01.429357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:01.429357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:01.429357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:01.429357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:01.429357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:01.429357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:16:01.429357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:01.429357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:01.429357 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.430779 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:01.806794 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:01.808412 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:01.808671 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:01.809010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.810169 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:01.810169 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:01.810169 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:01.810169 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:01.810169 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:01.810169 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:01.810169 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.810169 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:01.812238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.812238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:01.812238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:01.812238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:01.812238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:01.812238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:01.812238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:01.812238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:01.812238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:01.812238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:01.812238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:01.812238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:01.812238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:01.812238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:16:01.812238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:01.812238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:01.812238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.813361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:01.814387 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:01.814387 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:16:01.814387 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:01.814387 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.814684 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:01.814684 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:01.814684 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:01.814684 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:01.814684 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:01.814684 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:01.814684 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.814684 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:01.815676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.815676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:01.815676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:01.815676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:01.815676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:01.815676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:01.815676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:01.815676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:01.815676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:01.815676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:01.815676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:01.815676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:01.815676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:01.815676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:01.815676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:01.815676 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:01.816248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:01.816248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:01.816248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:01.816248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:01.816248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:01.816248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:01.816248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.816248 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:01.817336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.817336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:01.817336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:01.817336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:01.817336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:01.817336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:01.817336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:01.817336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:01.817336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:01.817336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:01.817336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:01.817336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:01.817336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:01.817336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:16:01.817336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:16:01.817336 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:01.817803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:01.818358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:01.818358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.818358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:01.818358 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:01.818608 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:01.818947 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:01.819238 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.819781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:16:01.819781 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:01.819781 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:01.819781 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:01.819781 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:01.819781 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:01.819781 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.819781 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:01.820565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.820565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:01.820565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:01.820565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:01.820565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:01.820565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:01.820565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:01.820565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:01.820565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:01.820565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:01.820565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:01.820565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:01.820565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:01.820565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:01.820565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:01.821022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:01.821022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:01.821022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:01.821022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:01.821022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:01.821022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:01.821022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:01.821022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.821022 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:01.821633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.821633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:01.821633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:01.821633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:01.821633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:01.821633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:01.821633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:01.821633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:01.821633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:01.821633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:01.821633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:01.821633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:01.821633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:01.821633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:16:01.821633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:16:01.821633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:01.822107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:01.822645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.822645 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:01.824408 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:01.824949 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:01.825344 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:01.825553 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:01.825693 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.826196 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:01.826196 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:01.826196 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:01.826196 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:01.826196 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:01.826196 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:01.826196 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.826196 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:01.827936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.827936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:01.827936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:01.827936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:01.827936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:01.827936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:01.827936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:01.827936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:01.827936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:01.827936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:01.827936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:01.827936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:01.827936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:01.827936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:16:01.827936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:01.827936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:01.827936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:01.828607 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:06.384913 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:06.387149 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:06.423740 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:06.423740 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.424490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:16:06.424490 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:06.424490 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:06.424490 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:06.424490 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:06.424490 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:06.424490 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.424490 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:06.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:06.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:06.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:06.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:06.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:06.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:06.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:06.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:06.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:06.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:06.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:06.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:06.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:16:06.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:06.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:06.425628 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.426634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:06.807503 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:06.809024 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:06.809285 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:06.809441 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.810262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:06.810262 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:06.810262 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:06.810262 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:06.810262 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:06.810262 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:06.810262 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.810262 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:06.812486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.812486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:06.812486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:06.812486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:06.812486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:06.812486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:06.812486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:06.812486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:06.812486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:06.812486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:06.812486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:06.812486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:06.812486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:06.812486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:16:06.812486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:06.812486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:06.812486 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.813281 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:06.813776 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:06.813876 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:16:06.814370 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:06.814640 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.815318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:06.815318 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:06.815318 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:06.815318 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:06.815318 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:06.815318 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:06.815318 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.815318 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:06.816504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.816504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:06.816504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:06.816504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:06.816504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:06.816504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:06.816504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:06.816504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:06.816504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:06.816504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:06.816504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:06.816504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:06.816504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:06.816504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:06.816504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:06.816504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:06.817038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:06.817038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:06.817038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:06.817038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:06.817038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:06.817038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:06.817038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.817038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:06.817680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.817680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:06.817680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:06.817680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:06.817680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:06.817680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:06.817680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:06.817680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:06.817680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:06.817680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:06.817680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:06.817680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:06.817680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:06.817680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:16:06.817680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:16:06.817680 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:06.818256 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:06.818766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:06.818766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.818766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:06.818766 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:06.819152 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:06.819536 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:06.819798 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.820423 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:16:06.820423 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:06.820423 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:06.820423 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:06.820423 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:06.820423 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:06.820423 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.820423 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:06.821761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.821761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:06.821761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:06.821761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:06.821761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:06.821761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:06.821761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:06.821761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:06.821761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:06.821761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:06.821761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:06.821761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:06.821761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:06.821761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:06.821761 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:06.822280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:06.822280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:06.822280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:06.822280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:06.822280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:06.822280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:06.822280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:06.822280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.822280 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:06.823648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.823648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:06.823648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:06.823648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:06.823648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:06.823648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:06.823648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:06.823648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:06.823648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:06.823648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:06.823648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:06.823648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:06.823648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:06.823648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:16:06.823648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:16:06.823648 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:06.824143 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:06.824654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.824654 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:06.825114 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:06.825880 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:06.826326 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:06.826599 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:06.826788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.827413 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:06.827413 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:06.827413 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:06.827413 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:06.827413 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:06.827413 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:06.827413 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.827413 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:06.828649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.828649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:06.828649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:06.828649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:06.828649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:06.828649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:06.828649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:06.828649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:06.828649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:06.828649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:06.828649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:06.828649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:06.828649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:06.828649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:16:06.828649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:06.828649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:06.828649 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:06.829344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:11.386237 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:11.388151 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:11.425030 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:11.425323 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.425969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:16:11.425969 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:11.425969 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:11.425969 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:11.425969 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:11.425969 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:11.425969 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.425969 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:11.427121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.427121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:11.427121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:11.427121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:11.427121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:11.427121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:11.427121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:11.427121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:11.427121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:11.427121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:11.427121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:11.427121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:11.427121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:11.427121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:16:11.427121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:11.427121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:11.427121 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.428461 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:11.808300 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:11.809825 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:11.810201 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:11.810449 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.811375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:11.811375 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:11.811375 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:11.811375 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:11.811375 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:11.811375 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:11.811375 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.811375 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:11.813520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.813520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:11.813520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:11.813520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:11.813520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:11.813520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:11.813520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:11.813520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:11.813520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:11.813520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:11.813520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:11.813520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:11.813520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:11.813520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:16:11.813520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:11.813520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:11.813520 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.814391 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:11.815409 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:11.815409 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:16:11.815409 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:11.815409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.815789 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:11.815789 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:11.815789 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:11.815789 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:11.815789 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:11.815789 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:11.815789 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.815789 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:11.816512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.816512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:11.816512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:11.816512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:11.816512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:11.816512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:11.816512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:11.816512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:11.816512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:11.816512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:11.816512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:11.816512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:11.816512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:11.816512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:11.816512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:11.816512 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:11.817377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:11.817377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:11.817377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:11.817377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:11.817377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:11.817377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:11.817377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.817377 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:11.817769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.817769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:11.817769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:11.817769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:11.817769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:11.817769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:11.817769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:11.817769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:11.817769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:11.817769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:11.817769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:11.817769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:11.817769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:11.817769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:16:11.817769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:16:11.817769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:11.818481 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:11.819465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:11.819465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.819465 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:11.819465 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:11.819465 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:11.819938 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:11.820316 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.821006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:16:11.821006 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:11.821006 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:11.821006 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:11.821006 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:11.821006 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:11.821006 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.821006 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:11.821950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.821950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:11.821950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:11.821950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:11.821950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:11.821950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:11.821950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:11.821950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:11.821950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:11.821950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:11.821950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:11.821950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:11.821950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:11.821950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:11.821950 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:11.822434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:11.822434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:11.822434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:11.822434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:11.822434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:11.822434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:11.822434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:11.822434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.822434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:11.822830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.822830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:11.822830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:11.822830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:11.822830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:11.822830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:11.822830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:11.822830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:11.822830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:11.822830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:11.822830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:11.822830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:11.822830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:11.822830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:16:11.822830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:16:11.822830 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:11.823421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:11.823952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.823952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:11.825754 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:11.826484 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:11.826974 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:11.827295 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:11.827452 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.828082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:11.828082 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:11.828082 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:11.828082 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:11.828082 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:11.828082 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:11.828082 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.828082 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:11.829737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.829737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:11.829737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:11.829737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:11.829737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:11.829737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:11.829737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:11.829737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:11.829737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:11.829737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:11.829737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:11.829737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:11.829737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:11.829737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:16:11.829737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:11.829737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:11.829737 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:11.830247 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:16.387663 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:16.389093 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:16.427319 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:16.427583 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.428278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:16:16.428278 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:16.428278 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:16.428278 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:16.428278 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:16.428278 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:16.428278 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.428278 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:16.429509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.429509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:16.429509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:16.429509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:16.429509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:16.429509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:16.429509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:16.429509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:16.429509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:16.429509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:16.429509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:16.429509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:16.429509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:16.429509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:16:16.429509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:16.429509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:16.429509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.430523 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:16.809075 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:16.810537 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:16.810537 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:16.810827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.811446 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:16.811446 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:16.811446 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:16.811446 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:16.811446 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:16.811446 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:16.811446 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.811446 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:16.813712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.813712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:16.813712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:16.813712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:16.813712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:16.813712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:16.813712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:16.813712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:16.813712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:16.813712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:16.813712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:16.813712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:16.813712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:16.813712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:16:16.813712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:16.813712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:16.813712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.814487 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:16.815251 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:16.815251 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:16:16.815251 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:16.815251 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.815664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:16.815664 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:16.815664 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:16.815664 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:16.815664 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:16.815664 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:16.815664 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.815664 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:16.817197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.817197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:16.817197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:16.817197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:16.817197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:16.817197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:16.817197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:16.817197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:16.817197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:16.817197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:16.817197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:16.817197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:16.817197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:16.817197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:16.817197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:16.817197 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:16.817712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:16.817712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:16.817712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:16.817712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:16.817712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:16.817712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:16.817712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.817712 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:16.819110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.819110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:16.819110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:16.819110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:16.819110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:16.819110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:16.819110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:16.819110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:16.819110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:16.819110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:16.819110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:16.819110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:16.819110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:16.819110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:16:16.819110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:16:16.819110 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:16.819547 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:16.820118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:16.820118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.820118 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:16.820118 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:16.820118 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:16.820414 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:16.820697 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.821570 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:16:16.821570 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:16.821570 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:16.821570 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:16.821570 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:16.821570 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:16.821570 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.821570 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:16.822279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.822279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:16.822279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:16.822279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:16.822279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:16.822279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:16.822279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:16.822279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:16.822279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:16.822279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:16.822279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:16.822279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:16.822279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:16.822279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:16.822279 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:16.822850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:16.822850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:16.822850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:16.822850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:16.822850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:16.822850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:16.822850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:16.822850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.822850 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:16.823484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.823484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:16.823484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:16.823484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:16.823484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:16.823484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:16.823484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:16.823484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:16.823484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:16.823484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:16.823484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:16.823484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:16.823484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:16.823484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:16:16.823484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:16:16.823484 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:16.824021 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:16.824546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.824546 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:16.826299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:16.826665 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:16.827478 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:16.828933 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:16.828933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.828933 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:16.828933 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:16.828933 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:16.828933 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:16.828933 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:16.828933 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:16.828933 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.828933 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:16.830343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.830343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:16.830343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:16.830343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:16.830343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:16.830343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:16.830343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:16.830343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:16.830343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:16.830343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:16.830343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:16.830343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:16.830343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:16.830343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:16:16.830343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:16.830343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:16.830343 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:16.831091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:21.388483 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:21.390541 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:21.406463 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=239 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:16:21.427826 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:21.428071 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:16:21.428814 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:21.428814 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:21.428814 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:21.428814 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:21.428814 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:21.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.428814 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:21.429846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.429846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:21.429846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:21.429846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:21.429846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:21.429846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:21.429846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:21.429846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:21.429846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:21.429846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:21.429846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:21.429846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:21.429846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:21.429846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:16:21.429846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:21.429846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:21.429846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.430962 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:21.810186 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:21.811537 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:21.811905 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:21.812258 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.813186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:21.813186 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:21.813186 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:21.813186 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:21.813186 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:21.813186 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:21.813186 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.813186 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:21.814100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.814100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:21.814100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:21.814100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:21.814100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:21.814100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:21.814100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:21.814100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:21.814100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:21.814100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:21.814100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:21.814100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:21.814100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:21.814100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:16:21.814100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:21.814100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:21.814100 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.815375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:21.816931 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:21.816931 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:16:21.816931 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:21.816931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.816931 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:21.816931 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:21.816931 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:21.816931 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:21.816931 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:21.816931 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:21.816931 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.816931 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:21.817550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.817550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:21.817550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:21.817550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:21.817550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:21.817550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:21.817550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:21.817550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:21.817550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:21.817550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:21.817550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:21.817550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:21.817550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:21.817550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:21.817550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:21.817550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:21.818556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:21.818556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:21.818556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:21.818556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:21.818556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:21.818556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:21.818556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.818556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:21.818556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.818556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:21.818556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:21.818556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:21.818556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:21.818556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:21.818556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:21.818556 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:21.819470 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:21.820083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:21.820083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:21.820083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:21.820083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:21.820083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:21.820083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:21.820083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:21.820083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:21.820083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:21.820083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.820083 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:21.820083 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:21.820522 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:21.821142 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:21.821525 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.822358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:16:21.822358 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:21.822358 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:21.822358 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:21.822358 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:21.822358 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:21.822358 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.822358 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:21.823459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.823459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:21.823459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:21.823459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:21.823459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:21.823459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:21.823459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:21.823459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:21.823459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:21.823459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:21.823459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:21.823459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:21.823459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:21.823459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:21.823459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:21.823859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:21.823859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:21.823859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:21.823859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:21.823859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:21.823859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:21.823859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:21.823859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.823859 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:21.824660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.824660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:21.824660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:21.824660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:21.824660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:21.824660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:21.824660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:21.824660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:21.824660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:21.824660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:21.824660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:21.824660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:21.824660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:21.824660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:16:21.824660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:16:21.824660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:21.825156 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:21.825662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.825662 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:21.826824 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:21.827291 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:21.827691 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:21.827960 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:21.828139 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.828668 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:21.828668 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:21.828668 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:21.828668 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:21.828668 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:21.828668 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:21.828668 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.828668 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:21.829871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.829871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:21.829871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:21.829871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:21.829871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:21.829871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:21.829871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:21.829871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:21.829871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:21.829871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:21.829871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:21.829871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:21.829871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:21.829871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:16:21.829871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:21.829871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:21.829871 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:21.830394 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:26.389364 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:26.391493 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:26.424433 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:26.425231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.425499 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:16:26.425499 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:26.425499 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:26.425499 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:26.425499 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:26.425499 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:26.425499 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.425499 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:26.426691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.426691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:26.426691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:26.426691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:26.426691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:26.426691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:26.426691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:26.426691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:26.426691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:26.426691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:26.426691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:26.426691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:26.426691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:26.426691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:16:26.426691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:26.426691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:26.426691 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.428124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:26.810726 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:26.812267 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:26.812708 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:26.813003 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.814091 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:26.814091 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:26.814091 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:26.814091 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:26.814091 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:26.814091 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:26.814091 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.814091 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:26.815966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.815966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:26.815966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:26.815966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:26.815966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:26.815966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:26.815966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:26.815966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:26.815966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:26.815966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:26.815966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:26.815966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:26.815966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:26.815966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:16:26.815966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:26.815966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:26.815966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.817253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:26.817831 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:26.817831 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:16:26.817831 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:26.817831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.818388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:26.818388 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:26.818388 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:26.818388 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:26.818388 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:26.818388 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:26.818388 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.818388 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:26.819825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.819825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:26.819825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:26.819825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:26.819825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:26.819825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:26.819825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:26.819825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:26.819825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:26.819825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:26.819825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:26.819825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:26.819825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:26.819825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:26.819825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:26.819825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:26.820612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:26.820612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:26.820612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:26.820612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:26.820612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:26.820612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:26.820612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.820612 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:26.821846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.821846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:26.821846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:26.821846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:26.821846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:26.821846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:26.821846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:26.821846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:26.821846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:26.821846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:26.821846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:26.821846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:26.821846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:26.821846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:16:26.821846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:16:26.821846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:26.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:26.823166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:26.823166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.823166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:26.823166 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:26.823166 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:26.824388 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:26.825011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.825796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:26.825796 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:26.825796 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:26.825796 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:26.825796 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:26.825796 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:26.825796 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.825796 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:26.827094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.827094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:26.827094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:26.827094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:26.827094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:26.827094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:26.827094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:26.827094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:26.827094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:26.827094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:26.827094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:26.827094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:26.827094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:26.827094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:26.827094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:26.827094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:26.827706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:26.827706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:26.827706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:26.827706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:26.827706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:26.827706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:26.827706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.827706 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:26.828839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.828839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:26.828839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:26.828839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:26.828839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:26.828839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:26.828839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:26.828839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:26.828839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:26.828839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:26.828839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:26.828839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:26.828839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:26.828839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:16:26.828839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:16:26.828839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:26.829528 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:26.830216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.830216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:26.830216 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:26.830216 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:26.830216 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:26.830216 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:26.830216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.830687 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:26.830687 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:26.830687 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:26.830687 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:26.830687 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:26.830687 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:26.830687 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.830687 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:26.831671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.831671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:26.831671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:26.831671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:26.831671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:26.831671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:26.831671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:26.831671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:26.831671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:26.831671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:26.831671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:26.831671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:26.831671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:26.831671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:16:26.831671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:26.831671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:26.831671 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:26.832678 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:31.390089 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:31.391649 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:31.426040 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:31.426327 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.426973 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:16:31.426973 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:31.426973 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:31.426973 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:31.426973 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:31.426973 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:31.426973 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.426973 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:31.428232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.428232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:31.428232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:31.428232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:31.428232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:31.428232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:31.428232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:31.428232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:31.428232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:31.428232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:31.428232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:31.428232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:31.428232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:31.428232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:16:31.428232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:31.428232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:31.428232 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.428881 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:31.811497 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:31.812664 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:31.812936 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:31.813239 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.814370 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:31.814370 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:31.814370 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:31.814370 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:31.814370 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:31.814370 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:31.814370 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.814370 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:31.816542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.816542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:31.816542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:31.816542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:31.816542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:31.816542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:31.816542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:31.816542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:31.816542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:31.816542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:31.816542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:31.816542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:31.816542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:31.816542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:16:31.816542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:31.816542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:31.816542 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.818115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:31.819024 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:31.819024 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:16:31.819024 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:31.819024 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.819591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:16:31.819591 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:31.819591 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:31.819591 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:31.819591 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:31.819591 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:31.819591 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.819591 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:31.821225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.821225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:31.821225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:31.821225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:31.821225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:31.821225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:31.821225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:31.821225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:31.821225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:31.821225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:31.821225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:31.821225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:31.821225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:31.821225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:31.821225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:31.822613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:31.822613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:31.822613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:31.822613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:31.822613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:31.822613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:31.822613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:31.822613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.822613 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:31.823173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.823173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:31.823173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:31.823173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:31.823173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:31.823173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:31.823173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:31.823173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:31.823173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:31.823173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:31.823173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:31.823173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:31.823173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:31.823173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:16:31.823173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:16:31.823173 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:31.823530 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:31.824006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:31.824006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.824006 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:31.824006 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:31.824006 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:31.824769 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:31.824769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.825161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:31.825161 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:31.825161 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:31.825161 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:31.825161 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:31.825161 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:31.825161 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.825161 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:31.826532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.826532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:31.826532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:31.826532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:31.826532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:31.826532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:31.826532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:31.826532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:31.826532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:31.826532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:31.826532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:31.826532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:31.826532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:31.826532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:31.826532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:31.826532 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:31.827294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:31.827294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:31.827294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:31.827294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:31.827294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:31.827294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:31.827294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.827294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:31.828271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.828271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:31.828271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:31.828271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:31.828271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:31.828271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:31.828271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:31.828271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:31.828271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:31.828271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:31.828271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:31.828271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:31.828271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:31.828271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:16:31.828271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:16:31.828271 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:31.829259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:31.830107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.830107 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:31.830107 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:31.830107 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:31.830107 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:31.830392 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:31.830521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.830946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:31.830946 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:31.830946 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:31.830946 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:31.830946 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:31.830946 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:31.830946 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.830946 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:31.831969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.831969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:31.831969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:31.831969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:31.831969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:31.831969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:31.831969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:31.831969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:31.831969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:31.831969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:31.831969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:31.831969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:31.831969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:31.831969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:16:31.831969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:31.831969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:31.831969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:31.832639 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:36.390763 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:36.392555 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:36.427189 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:36.427462 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.428182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:16:36.428182 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:36.428182 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:36.428182 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:36.428182 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:36.428182 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:36.428182 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.428182 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:36.429415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.429415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:36.429415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:36.429415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:36.429415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:36.429415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:36.429415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:36.429415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:36.429415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:36.429415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:36.429415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:36.429415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:36.429415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:36.429415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:16:36.429415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:36.429415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:36.429415 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.430000 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:36.812052 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:36.813584 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:36.814847 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:36.814847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.814847 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:36.814847 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:36.814847 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:36.814847 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:36.814847 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:36.814847 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:36.814847 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.814847 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:36.817057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.817057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:36.817057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:36.817057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:36.817057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:36.817057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:36.817057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:36.817057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:36.817057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:36.817057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:36.817057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:36.817057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:36.817057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:36.817057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:16:36.817057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:36.817057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:36.817057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.817560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:36.817898 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:36.818056 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:16:36.818452 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:36.818641 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.819312 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:16:36.819312 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:36.819312 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:36.819312 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:36.819312 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:36.819312 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:36.819312 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.819312 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:36.820535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.820535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:36.820535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:36.820535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:36.820535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:36.820535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:36.820535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:36.820535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:36.820535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:36.820535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:36.820535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:36.820535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:36.820535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:36.820535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:36.820535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:36.821094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:36.821094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:36.821094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:36.821094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:36.821094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:36.821094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:36.821094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:36.821094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.821094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:36.821622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.821622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:36.821622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:36.821622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:36.821622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:36.821622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:36.821622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:36.821622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:36.821622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:36.821622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:36.821622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:36.821622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:36.821622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:36.821622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:16:36.821622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:16:36.821622 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:36.822116 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:36.822611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:36.822611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.822611 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:36.823807 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:36.824483 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:36.824958 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:36.825315 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.825901 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:36.825901 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:36.825901 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:36.825901 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:36.825901 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:36.825901 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:36.825901 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.825901 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:36.826710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.826710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:36.826710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:36.826710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:36.826710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:36.826710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:36.826710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:36.826710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:36.826710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:36.826710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:36.826710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:36.826710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:36.826710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:36.826710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:36.826710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:36.826710 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:36.827147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:36.827147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:36.827147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:36.827147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:36.827147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:36.827147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:36.827147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.827147 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:36.827833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.827833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:36.827833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:36.827833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:36.827833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:36.827833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:36.827833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:36.827833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:36.827833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:36.827833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:36.827833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:36.827833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:36.827833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:36.827833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:16:36.827833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:16:36.827833 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:36.828172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:36.828491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.828491 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:36.830167 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:36.830891 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:36.831305 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:36.831598 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:36.831815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.832490 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:36.832490 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:36.832490 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:36.832490 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:36.832490 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:36.832490 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:36.832490 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.832490 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:36.833582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.833582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:36.833582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:36.833582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:36.833582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:36.833582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:36.833582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:36.833582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:36.833582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:36.833582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:36.833582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:36.833582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:36.833582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:36.833582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:16:36.833582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:36.833582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:36.833582 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:36.834094 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:41.391475 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:41.392741 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:41.426371 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:41.427050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.427619 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:16:41.427619 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:41.427619 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:41.427619 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:41.427619 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:41.427619 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:41.427619 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.427619 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:41.428733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.428733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:41.428733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:41.428733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:41.428733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:41.428733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:41.428733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:41.428733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:41.428733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:41.428733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:41.428733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:41.428733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:41.428733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:41.428733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:16:41.428733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:41.428733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:41.428733 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.429303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:41.812796 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:41.813942 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:41.814195 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:41.814352 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.814947 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:41.814947 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:41.814947 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:41.814947 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:41.814947 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:41.814947 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:41.814947 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.814947 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:41.816063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.816063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:41.816063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:41.816063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:41.816063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:41.816063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:41.816063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:41.816063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:41.816063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:41.816063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:41.816063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:41.816063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:41.816063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:41.816063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:16:41.816063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:41.816063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:41.816063 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.816760 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:41.818025 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:41.818469 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:16:41.818950 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:41.819148 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.819660 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:16:41.819660 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:41.819660 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:41.819660 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:41.819660 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:41.819660 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:41.819660 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.819660 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:41.821023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.821023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:41.821023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:41.821023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:41.821023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:41.821023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:41.821023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:41.821023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:41.821023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:41.821023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:41.821023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:41.821023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:41.821023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:41.821023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:41.821023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:41.821592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:41.821592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:41.821592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:41.821592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:41.821592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:41.821592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:41.821592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:41.821592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.821592 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:41.822591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.822591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:41.822591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:41.822591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:41.822591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:41.822591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:41.822591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:41.822591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:41.822591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:41.822591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:41.822591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:41.822591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:41.822591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:41.822591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:16:41.822591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:16:41.822591 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:41.823165 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:41.823766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:41.823766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.823766 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:41.824260 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:41.824544 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:41.825231 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:41.825581 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.826252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:41.826252 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:41.826252 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:41.826252 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:41.826252 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:41.826252 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:41.826252 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.826252 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:41.827011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.827011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:41.827011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:41.827011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:41.827011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:41.827011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:41.827011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:41.827011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:41.827011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:41.827011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:41.827011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:41.827011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:41.827011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:41.827011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:41.827011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:41.827011 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:41.827495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:41.827495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:41.827495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:41.827495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:41.827495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:41.827495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:41.827495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.827495 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:41.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:41.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:41.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:41.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:41.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:41.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:41.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:41.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:41.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:41.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:41.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:41.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:41.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:16:41.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:16:41.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:41.828524 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:41.829062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.829062 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:41.830599 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:41.830816 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:41.831707 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:41.831948 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:41.832257 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.832912 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:41.832912 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:41.832912 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:41.832912 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:41.832912 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:41.832912 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:41.832912 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.832912 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:41.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:41.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:41.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:41.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:41.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:41.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:41.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:41.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:41.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:41.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:41.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:41.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:41.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:16:41.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:41.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:41.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:41.834718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:46.392218 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:46.393808 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:46.433351 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:46.434025 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.434890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:16:46.434890 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:46.434890 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:46.434890 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:46.434890 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:46.434890 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:46.434890 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.434890 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:46.436240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.436240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:46.436240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:46.436240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:46.436240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:46.436240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:46.436240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:46.436240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:46.436240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:46.436240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:46.436240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:46.436240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:46.436240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:46.436240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:16:46.436240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:46.436240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:46.436240 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.437012 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:46.813855 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:46.816017 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:46.816428 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:46.816796 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.817792 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:46.817792 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:46.817792 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:46.817792 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:46.817792 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:46.817792 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:46.817792 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.817792 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:46.819880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.819880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:46.819880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:46.819880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:46.819880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:46.819880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:46.819880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:46.819880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:46.819880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:46.819880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:46.819880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:46.819880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:46.819880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:46.819880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:16:46.819880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:46.819880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:46.819880 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.820890 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:46.821681 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:46.821681 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:16:46.821681 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:46.821846 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.822647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:46.822647 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:46.822647 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:46.822647 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:46.822647 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:46.822647 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:46.822647 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.822647 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:46.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:46.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:46.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:46.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:46.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:46.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:46.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:46.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:46.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:46.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:46.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:46.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:46.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:46.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:46.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:46.824558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:46.824558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:46.824558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:46.824558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:46.824558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:46.824558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:46.824558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.824558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:46.826659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.826659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:46.826659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:46.826659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:46.826659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:46.826659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:46.826659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:46.826659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:46.826659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:46.826659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:46.826659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:46.826659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:46.826659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:46.826659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:16:46.826659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:16:46.826659 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:46.827180 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:46.827716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:46.827716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.827716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:46.827716 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:46.827716 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:46.827716 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:46.827889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.828388 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:46.828388 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:46.828388 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:46.828388 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:46.828388 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:46.828388 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:46.828388 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.828388 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:46.829399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.829399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:46.829399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:46.829399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:46.829399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:46.829399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:46.829399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:46.829399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:46.829399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:46.829399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:46.829399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:46.829399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:46.829399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:46.829399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:46.829399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:46.829399 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:46.829817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:46.829817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:46.829817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:46.829817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:46.829817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:46.829817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:46.829817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.829817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:46.830453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.830453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:46.830453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:46.830453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:46.830453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:46.830453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:46.830453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:46.830453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:46.830453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:46.830453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:46.830453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:46.830453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:46.830453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:46.830453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:16:46.830453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:16:46.830453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:46.830874 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:46.831356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.831356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:46.831356 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:46.831618 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:46.831959 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:46.832192 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:46.832334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:16:46.832827 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:46.832827 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:46.832827 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:46.832827 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:46.832827 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:46.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.832827 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:46.834044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.834044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:46.834044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:46.834044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:46.834044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:46.834044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:46.834044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:46.834044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:46.834044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:46.834044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:46.834044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:46.834044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:46.834044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:46.834044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:16:46.834044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:46.834044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:46.834044 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:46.834521 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:51.393105 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:51.394241 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:51.430701 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:51.431050 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.432092 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:16:51.432092 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:51.432092 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:51.432092 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:51.432092 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:51.432092 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:51.432092 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.432092 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:51.433297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.433297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:51.433297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:51.433297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:51.433297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:51.433297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:51.433297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:51.433297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:51.433297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:51.433297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:51.433297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:51.433297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:51.433297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:51.433297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:16:51.433297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:51.433297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:51.433297 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.434335 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:51.814834 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:51.816265 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:51.816673 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:51.817031 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.818160 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:51.818160 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:51.818160 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:51.818160 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:51.818160 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:51.818160 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:51.818160 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.818160 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:51.819902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.819902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:51.819902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:51.819902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:51.819902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:51.819902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:51.819902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:51.819902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:51.819902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:51.819902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:51.819902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:51.819902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:51.819902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:51.819902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:16:51.819902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:51.819902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:51.819902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.821084 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:51.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:51.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:16:51.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:51.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:51.822421 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:51.822421 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:51.822421 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:51.822421 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:51.822421 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:51.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.822421 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:51.823839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.823839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:51.823839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:51.823839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:51.823839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:51.823839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:51.823839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:51.823839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:51.823839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:51.823839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:51.823839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:51.823839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:51.823839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:51.823839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:51.823839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:51.823839 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:51.824576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:51.824576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:51.824576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:51.824576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:51.824576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:51.824576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:51.824576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.824576 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:51.825504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.825504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:51.825504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:51.825504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:51.825504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:51.825504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:51.825504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:51.825504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:51.825504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:51.825504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:51.825504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:51.825504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:51.825504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:51.825504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:16:51.825504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:16:51.825504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:51.826355 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:51.827124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:51.827124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.827124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:51.827392 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:51.827773 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:51.828157 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:51.828471 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.829010 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:16:51.829010 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:51.829010 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:51.829010 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:51.829010 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:51.829010 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:51.829010 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.829010 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:51.829741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.829741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:51.829741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:51.829741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:51.829741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:51.829741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:51.829741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:51.829741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:51.829741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:51.829741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:51.829741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:51.829741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:51.829741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:51.829741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:51.829741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:51.830443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:51.830443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:51.830443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:51.830443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:51.830443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:51.830443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:51.830443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:51.830443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.830443 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:51.830844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.830844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:51.830844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:51.830844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:51.830844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:51.830844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:51.830844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:51.830844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:51.830844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:51.830844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:51.830844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:51.830844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:51.830844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:51.830844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:16:51.830844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:16:51.830844 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:51.831578 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:51.832386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.832386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:51.832386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:51.832386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:51.832386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:51.832386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:51.832386 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.832745 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:51.832745 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:51.832745 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:51.832745 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:51.832745 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:51.832745 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:51.832745 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.832745 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:51.833527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.833527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:51.833527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:51.833527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:51.833527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:51.833527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:51.833527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:51.833527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:51.833527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:51.833527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:51.833527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:51.833527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:51.833527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:51.833527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:16:51.833527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:51.833527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:51.833527 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:51.834362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:56.393653 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:56.394840 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:56.427930 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:56.428321 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.429302 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:16:56.429302 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:56.429302 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:56.429302 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:56.429302 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:56.429302 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:56.429302 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.429302 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:56.430539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.430539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:56.430539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:56.430539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:56.430539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:56.430539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:56.430539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:56.430539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:56.430539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:56.430539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:56.430539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:56.430539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:56.430539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:56.430539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:16:56.430539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:56.430539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:56.430539 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.431550 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:56.815494 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:56.816674 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:56.817061 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:56.817310 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.818166 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:56.818166 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:56.818166 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:56.818166 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:56.818166 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:56.818166 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:56.818166 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.818166 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:56.819344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.819344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:56.819344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:56.819344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:56.819344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:56.819344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:56.819344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:56.819344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:56.819344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:56.819344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:56.819344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:56.819344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:56.819344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:56.819344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:16:56.819344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:56.819344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:56.819344 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.819899 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:56.821125 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:56.821473 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:16:56.821943 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:56.822278 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.823073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:16:56.823073 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:56.823073 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:56.823073 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:56.823073 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:56.823073 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:56.823073 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.823073 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:56.825181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.825181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:56.825181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:56.825181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:56.825181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:56.825181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:56.825181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:56.825181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:56.825181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:56.825181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:56.825181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:56.825181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:56.825181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:56.825181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:56.825181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:56.825181 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:56.825797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:56.825797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:56.825797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:56.825797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:56.825797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:56.825797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:56.825797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.825797 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:56.826231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.826231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:56.826231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:56.826231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:56.826231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:56.826231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:56.826231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:56.826231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:56.826231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:56.826231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:56.826231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:56.826231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:56.826231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:56.826231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:16:56.826231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:16:56.826231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:56.826806 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:56.827618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:56.827618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.827618 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:56.827760 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:56.828354 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:56.828965 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:56.829390 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.830128 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:16:56.830128 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:56.830128 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:56.830128 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:56.830128 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:56.830128 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:56.830128 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.830128 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:56.831057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.831057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:16:56.831057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:56.831057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:56.831057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:56.831057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:56.831057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:56.831057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:56.831057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:56.831057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:16:56.831057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:56.831057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:16:56.831057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:56.831057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:16:56.831057 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:16:56.831748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:56.831748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:16:56.831748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:56.831748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:16:56.831748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:16:56.831748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:56.831748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:16:56.831748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.831748 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:16:56.832647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.832647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:56.832647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:56.832647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:56.832647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:56.832647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:56.832647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:56.832647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:56.832647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:56.832647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:56.832647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:56.832647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:56.832647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:56.832647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:16:56.832647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:16:56.832647 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:56.833222 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:56.834065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.834065 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:16:56.834951 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:16:56.835392 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:16:56.836101 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:56.836456 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:16:56.836781 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.837466 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:16:56.837466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:56.837466 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:16:56.837466 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:16:56.837466 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:56.837466 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:16:56.837466 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.837466 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:16:56.839183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.839183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:16:56.839183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:16:56.839183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:16:56.839183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:16:56.839183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:16:56.839183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:56.839183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:16:56.839183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:16:56.839183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:16:56.839183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:16:56.839183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:16:56.839183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:16:56.839183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:16:56.839183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:16:56.839183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:56.839183 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:16:56.839831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:01.394368 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:01.396701 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:01.438415 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:01.438834 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.440009 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:17:01.440009 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:01.440009 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:01.440009 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:01.440009 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:01.440009 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:01.440009 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.440009 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:01.441318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.441318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:01.441318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:01.441318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:01.441318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:01.441318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:01.441318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:01.441318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:01.441318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:01.441318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:01.441318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:01.441318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:01.441318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:01.441318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:17:01.441318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:01.441318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:01.441318 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.442564 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:01.816221 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:01.817374 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:01.817717 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:01.817998 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.818887 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:01.818887 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:01.818887 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:01.818887 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:01.818887 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:01.818887 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:01.818887 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.818887 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:01.820634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.820634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:01.820634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:01.820634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:01.820634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:01.820634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:01.820634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:01.820634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:01.820634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:01.820634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:01.820634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:01.820634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:01.820634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:01.820634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:17:01.820634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:01.820634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:01.820634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.821535 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:01.822551 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:01.822551 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:17:01.822551 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:01.822769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.823560 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:01.823560 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:01.823560 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:01.823560 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:01.823560 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:01.823560 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:01.823560 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.823560 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:01.824942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.824942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:01.824942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:01.824942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:01.824942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:01.824942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:01.824942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:01.824942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:01.824942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:01.824942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:01.824942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:01.824942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:01.824942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:01.824942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:01.824942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:01.824942 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:01.826182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:01.826182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:01.826182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:01.826182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:01.826182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:01.826182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:01.826182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.826182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:01.827088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.827088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:01.827088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:01.827088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:01.827088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:01.827088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:01.827088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:01.827088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:01.827088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:01.827088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:01.827088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:01.827088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:01.827088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:01.827088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:17:01.827088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:17:01.827088 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:01.828004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:01.828921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:01.828921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.828921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:01.828921 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:01.828921 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:01.828921 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:01.829322 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.829825 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:01.829825 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:01.829825 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:01.829825 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:01.829825 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:01.829825 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:01.829825 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.829825 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:01.831708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.831708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:01.831708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:01.831708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:01.831708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:01.831708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:01.831708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:01.831708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:01.831708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:01.831708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:01.831708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:01.831708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:01.831708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:01.831708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:01.831708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:01.831708 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:01.832176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:01.832176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:01.832176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:01.832176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:01.832176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:01.832176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:01.832176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.832176 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:01.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:01.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:01.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:01.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:01.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:01.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:01.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:01.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:01.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:01.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:01.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:01.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:01.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:17:01.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:17:01.833835 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:01.834672 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:01.835508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.835508 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:01.835508 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:01.836054 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:01.836718 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:01.837239 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:01.837485 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.838288 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:17:01.838288 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:01.838288 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:01.838288 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:01.838288 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:01.838288 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:01.838288 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.838288 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:01.839566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.839566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:01.839566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:01.839566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:01.839566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:01.839566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:01.839566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:01.839566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:01.839566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:01.839566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:01.839566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:01.839566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:01.839566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:01.839566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:17:01.839566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:01.839566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:01.839566 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:01.840252 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:06.395054 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:06.396787 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:06.433306 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:06.433741 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.434768 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:17:06.434768 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:06.434768 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:06.434768 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:06.434768 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:06.434768 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:06.434768 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.434768 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:06.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:06.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:06.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:06.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:06.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:06.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:06.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:06.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:06.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:06.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:06.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:06.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:06.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:17:06.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:06.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:06.435932 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.436946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:06.817114 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:06.818540 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:06.818906 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:06.819237 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.820342 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:06.820342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:06.820342 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:06.820342 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:06.820342 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:06.820342 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:06.820342 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.820342 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:06.822363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.822363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:06.822363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:06.822363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:06.822363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:06.822363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:06.822363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:06.822363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:06.822363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:06.822363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:06.822363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:06.822363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:06.822363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:06.822363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:17:06.822363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:06.822363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:06.822363 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.823375 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:06.824178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:06.824178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:17:06.824178 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:06.824384 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.825158 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:06.825158 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:06.825158 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:06.825158 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:06.825158 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:06.825158 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:06.825158 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.825158 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:06.826515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.826515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:06.826515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:06.826515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:06.826515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:06.826515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:06.826515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:06.826515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:06.826515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:06.826515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:06.826515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:06.826515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:06.826515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:06.826515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:06.826515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:06.826515 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:06.827122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:06.827122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:06.827122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:06.827122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:06.827122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:06.827122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:06.827122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.827122 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:06.828426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.828426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:06.828426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:06.828426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:06.828426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:06.828426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:06.828426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:06.828426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:06.828426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:06.828426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:06.828426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:06.828426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:06.828426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:06.828426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:17:06.828426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:17:06.828426 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:06.828951 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:06.829719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:06.829719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.829719 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:06.829719 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:06.829719 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:06.829962 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:06.830182 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.830808 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:06.830808 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:06.830808 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:06.830808 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:06.830808 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:06.830808 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:06.830808 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.830808 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:06.831993 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.831993 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:06.831993 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:06.831993 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:06.831993 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:06.831993 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:06.831993 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:06.831993 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:06.831993 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:06.831993 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:06.831993 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:06.831993 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:06.831993 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:06.831993 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:06.831993 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:06.831993 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:06.832664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:06.832664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:06.832664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:06.832664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:06.832664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:06.832664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:06.832664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.832664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:06.833646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.833646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:06.833646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:06.833646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:06.833646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:06.833646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:06.833646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:06.833646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:06.833646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:06.833646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:06.833646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:06.833646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:06.833646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:06.833646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:17:06.833646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:17:06.833646 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:06.834174 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:06.834817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.834817 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:06.836021 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:06.836855 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:06.837301 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:06.837572 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:06.837729 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.838361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:17:06.838361 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:06.838361 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:06.838361 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:06.838361 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:06.838361 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:06.838361 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.838361 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:06.839554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.839554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:06.839554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:06.839554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:06.839554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:06.839554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:06.839554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:06.839554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:06.839554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:06.839554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:06.839554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:06.839554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:06.839554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:06.839554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:17:06.839554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:06.839554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:06.839554 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:06.840074 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:11.395779 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:11.396842 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:11.429926 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:11.430199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.430902 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:17:11.430902 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:11.430902 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:11.430902 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:11.430902 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:11.430902 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:11.430902 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.430902 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:11.431810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.431810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:11.431810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:11.431810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:11.431810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:11.431810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:11.431810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:11.431810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:11.431810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:11.431810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:11.431810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:11.431810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:11.431810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:11.431810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:17:11.431810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:11.431810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:11.431810 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.432409 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:11.817807 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:11.819302 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:11.819792 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:11.820153 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.821136 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:11.821136 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:11.821136 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:11.821136 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:11.821136 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:11.821136 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:11.821136 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.821136 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:11.823198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.823198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:11.823198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:11.823198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:11.823198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:11.823198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:11.823198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:11.823198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:11.823198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:11.823198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:11.823198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:11.823198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:11.823198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:11.823198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:17:11.823198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:11.823198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:11.823198 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.824120 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:11.825226 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:11.825226 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:17:11.825226 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:11.825226 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.826004 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:11.826004 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:11.826004 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:11.826004 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:11.826004 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:11.826004 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:11.826004 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.826004 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:11.827250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.827250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:11.827250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:11.827250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:11.827250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:11.827250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:11.827250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:11.827250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:11.827250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:11.827250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:11.827250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:11.827250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:11.827250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:11.827250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:11.827250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:11.827250 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:11.827753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:11.827753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:11.827753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:11.827753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:11.827753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:11.827753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:11.827753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.827753 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:11.828502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.828502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:11.828502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:11.828502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:11.828502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:11.828502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:11.828502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:11.828502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:11.828502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:11.828502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:11.828502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:11.828502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:11.828502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:11.828502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:17:11.828502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:17:11.828502 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:11.828941 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:11.829459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:11.829459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.829459 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:11.829459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:11.829459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:11.829913 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:11.830216 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.830809 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:11.830809 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:11.830809 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:11.830809 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:11.830809 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:11.830809 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:11.830809 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.830809 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:11.832341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.832341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:11.832341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:11.832341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:11.832341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:11.832341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:11.832341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:11.832341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:11.832341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:11.832341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:11.832341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:11.832341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:11.832341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:11.832341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:11.832341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:11.832341 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:11.832788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:11.832788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:11.832788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:11.832788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:11.832788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:11.832788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:11.832788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.832788 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:11.834135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.834135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:11.834135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:11.834135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:11.834135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:11.834135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:11.834135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:11.834135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:11.834135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:11.834135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:11.834135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:11.834135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:11.834135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:11.834135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:17:11.834135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:17:11.834135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:11.834562 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:11.835066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.835066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:11.836459 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:11.836903 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:11.837245 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:11.837512 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:11.837730 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.838276 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:17:11.838276 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:11.838276 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:11.838276 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:11.838276 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:11.838276 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:11.838276 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.838276 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:11.839294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.839294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:11.839294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:11.839294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:11.839294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:11.839294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:11.839294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:11.839294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:11.839294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:11.839294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:11.839294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:11.839294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:11.839294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:11.839294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:17:11.839294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:11.839294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:11.839294 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:11.839770 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:16.396386 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:16.398122 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:16.434517 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:16.434930 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.435820 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:17:16.435820 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:16.435820 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:16.435820 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:16.435820 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:16.435820 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:16.435820 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.435820 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:16.436769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.436769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:16.436769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:16.436769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:16.436769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:16.436769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:16.436769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:16.436769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:16.436769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:16.436769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:16.436769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:16.436769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:16.436769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:16.436769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:17:16.436769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:16.436769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:16.436769 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.438078 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:16.818602 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:16.819813 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:16.820073 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:16.820259 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.820914 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:16.820914 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:16.820914 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:16.820914 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:16.820914 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:16.820914 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:16.820914 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.820914 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:16.823125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.823125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:16.823125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:16.823125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:16.823125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:16.823125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:16.823125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:16.823125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:16.823125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:16.823125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:16.823125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:16.823125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:16.823125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:16.823125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:17:16.823125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:16.823125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:16.823125 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.824233 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:16.826225 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:16.826225 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:17:16.826225 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:16.826225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.826225 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:16.826225 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:16.826225 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:16.826225 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:16.826225 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:16.826225 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:16.826225 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.826225 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:16.828064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.828064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:16.828064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:16.828064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:16.828064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:16.828064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:16.828064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:16.828064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:16.828064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:16.828064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:16.828064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:16.828064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:16.828064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:16.828064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:16.828064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:16.828064 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:16.829253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:16.829253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:16.829253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:16.829253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:16.829253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:16.829253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:16.829253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.829253 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:16.830555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.830555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:16.830555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:16.830555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:16.830555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:16.830555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:16.830555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:16.830555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:16.830555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:16.830555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:16.830555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:16.830555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:16.830555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:16.830555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:17:16.830555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:17:16.830555 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:16.831497 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:16.831889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:16.831889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.831889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:16.831889 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:16.831889 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:16.831889 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:16.831889 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.832500 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:16.832500 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:16.832500 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:16.832500 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:16.832500 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:16.832500 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:16.832500 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.832500 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:16.833605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.833605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:16.833605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:16.833605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:16.833605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:16.833605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:16.833605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:16.833605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:16.833605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:16.833605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:16.833605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:16.833605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:16.833605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:16.833605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:16.833605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:16.833605 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:16.833921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:16.833921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:16.833921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:16.833921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:16.833921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:16.833921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:16.833921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.833921 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:16.835191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.835191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:16.835191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:16.835191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:16.835191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:16.835191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:16.835191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:16.835191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:16.835191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:16.835191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:16.835191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:16.835191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:16.835191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:16.835191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:17:16.835191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:17:16.835191 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:16.835494 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:16.835815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.835815 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:16.836917 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:16.837433 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:16.837883 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:16.838274 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:16.838493 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.839282 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:17:16.839282 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:16.839282 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:16.839282 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:16.839282 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:16.839282 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:16.839282 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.839282 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:16.841082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.841082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:16.841082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:16.841082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:16.841082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:16.841082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:16.841082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:16.841082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:16.841082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:16.841082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:16.841082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:16.841082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:16.841082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:16.841082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:17:16.841082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:16.841082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:16.841082 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:16.841565 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:21.397144 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:21.398781 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:21.414224 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG dbcounter [-] [104575] Writing DB stats neutron:SELECT=242 {{(pid=104575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 07 20:17:21.434068 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:21.434496 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.435372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:17:21.435372 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:21.435372 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:21.435372 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:21.435372 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:21.435372 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:21.435372 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.435372 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:21.436328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.436328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:21.436328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:21.436328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:21.436328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:21.436328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:21.436328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:21.436328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:21.436328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:21.436328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:21.436328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:21.436328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:21.436328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:21.436328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:17:21.436328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:21.436328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:21.436328 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.436966 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:21.819297 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:21.820499 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:21.820805 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:21.821104 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.821936 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:21.821936 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:21.821936 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:21.821936 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:21.821936 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:21.821936 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:21.821936 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.821936 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:21.823601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.823601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:21.823601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:21.823601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:21.823601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:21.823601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:21.823601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:21.823601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:21.823601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:21.823601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:21.823601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:21.823601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:21.823601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:21.823601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:17:21.823601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:21.823601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:21.823601 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.824504 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:21.825259 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:21.825259 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:17:21.825576 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:21.825910 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.826735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:21.826735 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:21.826735 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:21.826735 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:21.826735 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:21.826735 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:21.826735 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.826735 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:21.828313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.828313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:21.828313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:21.828313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:21.828313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:21.828313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:21.828313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:21.828313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:21.828313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:21.828313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:21.828313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:21.828313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:21.828313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:21.828313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:21.828313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:21.828313 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:21.828970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:21.828970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:21.828970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:21.828970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:21.828970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:21.828970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:21.828970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.828970 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:21.829827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.829827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:21.829827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:21.829827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:21.829827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:21.829827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:21.829827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:21.829827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:21.829827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:21.829827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:21.829827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:21.829827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:21.829827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:21.829827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:17:21.829827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:17:21.829827 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:21.830304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:21.830831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:21.830831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.830831 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:21.830929 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:21.831420 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:21.832103 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:21.832358 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.833154 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:21.833154 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:21.833154 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:21.833154 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:21.833154 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:21.833154 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:21.833154 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.833154 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:21.834127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.834127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:21.834127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:21.834127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:21.834127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:21.834127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:21.834127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:21.834127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:21.834127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:21.834127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:21.834127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:21.834127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:21.834127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:21.834127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:21.834127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:21.834127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:21.835262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:21.835262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:21.835262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:21.835262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:21.835262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:21.835262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:21.835262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.835262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:21.835262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.835262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:21.835262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:21.835262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:21.835262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:21.835262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:21.835262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:21.835262 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:21.836199 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:21.837200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:21.837200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:21.837200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:21.837200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:21.837200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:21.837200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:21.837200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:21.837200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.837200 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:21.837637 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:21.837826 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:21.838200 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:21.838430 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:21.838599 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.839263 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:17:21.839263 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:21.839263 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:21.839263 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:21.839263 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:21.839263 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:21.839263 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.839263 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:21.840875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.840875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:21.840875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:21.840875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:21.840875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:21.840875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:21.840875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:21.840875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:21.840875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:21.840875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:21.840875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:21.840875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:21.840875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:21.840875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:17:21.840875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:21.840875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:21.840875 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:21.841362 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:26.398031 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:26.400308 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:26.440004 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:26.440303 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.441093 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:17:26.441093 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:26.441093 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:26.441093 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:26.441093 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:26.441093 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:26.441093 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.441093 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:26.442135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.442135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:26.442135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:26.442135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:26.442135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:26.442135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:26.442135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:26.442135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:26.442135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:26.442135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:26.442135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:26.442135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:26.442135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:26.442135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:17:26.442135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:26.442135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:26.442135 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.442725 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:26.830833 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:26.831172 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:26.831475 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:26.833322 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:17:26.834299 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:26.835038 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:26.835038 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:26.835038 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.836270 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:26.836270 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:26.836270 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:26.836270 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:26.836270 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:26.836270 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:26.836270 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.836270 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:26.836802 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:26.839231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.839231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:26.839231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:26.839231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:26.839231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:26.839231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:26.839231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:26.839231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:26.839231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:26.839231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:26.839231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:26.839231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:26.839231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:26.839231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:17:26.839231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:26.839231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:26.839231 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.839621 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:26.840066 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.840368 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:26.840763 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:26.840763 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:26.840763 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:26.840763 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:26.840763 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:26.840763 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:26.840763 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.840763 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:26.841481 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:26.842187 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:26.843567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.843567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:26.843567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:26.843567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:26.843567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:26.843567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:26.843567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:26.843567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:26.843567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:26.843567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:26.843567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:26.843567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:26.843567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:26.843567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:26.843567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:26.843567 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:26.843969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:26.843969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:26.843969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:26.843969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:26.843969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:26.843969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:26.843969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.843969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:26.844266 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.846642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.846642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:26.846642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:26.846642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:26.846642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:26.846642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:26.846642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:26.846642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:26.846642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:26.846642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:26.846642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:26.846642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:26.846642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:26.846642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:17:26.846642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:17:26.846642 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:26.846977 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:26.847359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:26.847359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.847359 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:26.847359 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:26.847474 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:26.847474 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:26.847474 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:26.847474 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:26.847474 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:26.847474 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:26.847474 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.847474 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:26.847692 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:26.848577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.848577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:26.848577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:26.848577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:26.848577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:26.848577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:26.848577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:26.848577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:26.848577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:26.848577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:26.848577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:26.848577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:26.848577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:26.848577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:26.848577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:26.848577 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:26.849042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:26.849042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:26.849042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:26.849042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:26.849042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:26.849042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:26.849042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.849042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:26.849042 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.849934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.849934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:26.849934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:26.849934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:26.849934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:26.849934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:26.849934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:26.849934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:26.849934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:26.849934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:26.849934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:26.849934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:26.849934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:26.849934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:17:26.849934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:17:26.849934 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:26.850406 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:26.850917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.850917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:26.850917 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Traceback (most recent call last):
Apr 07 20:17:26.850917 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:26.850917 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:26.850917 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:26.850917 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:26.850917 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:26.850917 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.850917 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:26.851633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-59abf225-b5c0-41db-8742-cc29cc0f609d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.851633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:26.851633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:26.851633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:26.851633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:26.851633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:26.851633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:26.851633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:26.851633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:26.851633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:26.851633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:26.851633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:26.851633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:26.851633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:17:26.851633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:26.851633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:26.851633 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:26.852127 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:31.398659 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:31.400205 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:31.435705 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:31.436172 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.437186 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:17:31.437186 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:31.437186 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:31.437186 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:31.437186 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:31.437186 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:31.437186 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.437186 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:31.438349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.438349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:31.438349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:31.438349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:31.438349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:31.438349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:31.438349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:31.438349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:31.438349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:31.438349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:31.438349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:31.438349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:31.438349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:31.438349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:17:31.438349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:31.438349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:31.438349 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.439453 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:31.832919 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:31.833554 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:31.833902 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:31.834248 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:17:31.834725 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:31.835004 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:31.835257 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:31.835421 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.836372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:31.836372 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:31.836372 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:31.836372 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:31.836372 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:31.836372 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:31.836372 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.836372 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:31.836962 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:31.839138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.839138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:31.839138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:31.839138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:31.839138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:31.839138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:31.839138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:31.839138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:31.839138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:31.839138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:31.839138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:31.839138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:31.839138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:31.839138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:17:31.839138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:31.839138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:31.839138 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.839803 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:31.840434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.840434 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:31.840434 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:31.840434 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:31.840434 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:31.840434 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:31.840434 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:31.840434 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.840434 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:31.841505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.841505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:31.841505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:31.841505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:31.841505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:31.841505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:31.841505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:31.841505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:31.841505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:31.841505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:31.841505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:31.841505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:31.841505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:31.841505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:31.841505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:31.841505 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:31.842076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:31.842076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:31.842076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:31.842076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:31.842076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:31.842076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:31.842076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.842076 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:31.842076 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:31.844018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.844018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:31.844018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:31.844018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:31.844018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:31.844018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:31.844018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:31.844018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:31.844018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:31.844018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:31.844018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:31.844018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:31.844018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:31.844018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:17:31.844018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:17:31.844018 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:31.844509 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:31.845099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:31.845099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.845099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:31.845099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.845099 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:31.845099 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:31.845099 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:31.845099 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:31.845099 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:31.845099 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:31.845099 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:31.845099 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.845099 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:31.846305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.846305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:31.846305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:31.846305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:31.846305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:31.846305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:31.846305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:31.846305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:31.846305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:31.846305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:31.846305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:31.846305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:31.846305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:31.846305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:31.846305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:31.846305 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:31.846742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:31.846742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:31.846742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:31.846742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:31.846742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:31.846742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:31.846742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.846742 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:31.846742 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:31.848036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.848036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:31.848036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:31.848036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:31.848036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:31.848036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:31.848036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:31.848036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:31.848036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:31.848036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:31.848036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:31.848036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:31.848036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:31.848036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:17:31.848036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:17:31.848036 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:31.848664 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:31.849286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.849286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:31.849286 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:31.849286 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:31.849286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.849286 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:31.849286 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:31.849286 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:31.849286 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:31.849286 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:31.849286 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:31.849286 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.849286 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:31.850334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.850334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:31.850334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:31.850334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:31.850334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:31.850334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:31.850334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:31.850334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:31.850334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:31.850334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:31.850334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:31.850334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:31.850334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:31.850334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:17:31.850334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:31.850334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:31.850334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:31.850865 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:36.399362 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:36.400379 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:36.439167 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:36.439536 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.440716 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:17:36.440716 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:36.440716 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:36.440716 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:36.440716 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:36.440716 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:36.440716 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.440716 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:36.441946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.441946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:36.441946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:36.441946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:36.441946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:36.441946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:36.441946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:36.441946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:36.441946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:36.441946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:36.441946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:36.441946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:36.441946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:36.441946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:17:36.441946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:36.441946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:36.441946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.443073 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:36.833287 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:36.834506 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:36.834831 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:36.835108 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.875304 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:36.875304 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:36.875304 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:36.875304 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:17:36.875304 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:36.875304 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:36.875905 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.877338 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:36.877634 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.878928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:17:36.878928 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:36.878928 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:36.878928 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:36.878928 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:36.878928 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:36.878928 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.878928 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:36.879615 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:36.879615 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:36.879615 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:36.879615 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:36.879615 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:36.879615 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:36.879615 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.879615 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:36.880580 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:36.881429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.881429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:36.881429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:36.881429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:36.881429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:36.881429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:36.881429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:36.881429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:36.881429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:36.881429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:36.881429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:36.881429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:36.881429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:36.881429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:36.881429 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:36.882080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:36.882080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:36.882080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:36.882080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:36.882080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:36.882080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:36.882080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:36.882080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.882080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:36.882080 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:36.882080 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:36.882080 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:36.882080 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:36.882080 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:36.882080 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:36.882080 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.882080 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:36.882952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.882952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:36.882952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:36.882952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:36.882952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:36.882952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:36.882952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:36.882952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:36.882952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:36.882952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:36.882952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:36.882952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:36.882952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:36.882952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:17:36.882952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:36.882952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:36.882952 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.883334 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:36.884369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.884369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:36.884369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:36.884369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:36.884369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:36.884369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:36.884369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:36.884369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:36.884369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:36.884369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:36.884369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:36.884369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:36.884369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:36.884369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:17:36.884369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:17:36.884369 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:36.884718 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:36.885115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:36.885115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.885115 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:36.885264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.885264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:36.885264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:36.885264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:36.885264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:36.885264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:36.885264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:36.885264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:36.885264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:36.885264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:36.885264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:36.885264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:36.885264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:36.885264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:36.885264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:36.885264 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:36.885586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:36.885586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:36.885586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:36.885586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:36.885586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:36.885586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:36.885586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.885586 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:36.885586 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:36.887361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.887361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:36.887361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:36.887361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:36.887361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:36.887361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:36.887361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:36.887361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:36.887361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:36.887361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:36.887361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:36.887361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:36.887361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:36.887361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:17:36.887361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:17:36.887361 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:36.887735 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:36.888161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.888161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:36.888161 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:36.888161 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.888438 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:36.888438 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:36.888438 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:36.888438 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:36.888438 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:36.888438 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:36.888438 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.888438 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:36.889778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.889778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:36.889778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:36.889778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:36.889778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:36.889778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:36.889778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:36.889778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:36.889778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:36.889778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:36.889778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:36.889778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:36.889778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:36.889778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:17:36.889778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:36.889778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:36.889778 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:36.890372 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:41.400172 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:41.401606 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:41.441607 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:41.441928 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.442876 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Traceback (most recent call last):
Apr 07 20:17:41.442876 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:41.442876 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:41.442876 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:41.442876 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:41.442876 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:41.442876 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.442876 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:41.444023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-855e32cd-c12b-4881-98e1-ddcadab8adbc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.444023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:41.444023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:41.444023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:41.444023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:41.444023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:41.444023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:41.444023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:41.444023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:41.444023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:41.444023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:41.444023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:41.444023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:41.444023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 07 20:17:41.444023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:41.444023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:41.444023 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.445489 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:41.834106 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:41.835626 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-be0f7b17-b70a-49a9-a4ef-08f78a968ad1, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:41.836020 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-6e977c5e-85a0-4398-b359-5ba638de167e, routes=[], if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:41.836304 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.837480 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:41.837480 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:41.837480 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:41.837480 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:41.837480 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:41.837480 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:41.837480 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.837480 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:41.838940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.838940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:41.838940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:41.838940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:41.838940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:41.838940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:41.838940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:41.838940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:41.838940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:41.838940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:41.838940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:41.838940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:41.838940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:41.838940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 07 20:17:41.838940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:41.838940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:41.838940 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.839979 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:41.874020 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:41.874183 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:41.874460 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104575) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 07 20:17:41.874844 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:41.875604 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:41.875946 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.877124 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:17:41.877124 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:41.877124 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:41.877124 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:41.877124 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:41.877124 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:41.877124 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.877124 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:41.878243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.878243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:41.878243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:41.878243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:41.878243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:41.878243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:41.878243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:41.878243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:41.878243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:41.878243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:41.878243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:41.878243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:41.878243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:41.878243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:41.878243 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:41.878904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:41.878904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:41.878904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:41.878904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:41.878904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:41.878904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:41.878904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:41.878904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.878904 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:41.878904 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:41.880203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.880203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:41.880203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:41.880203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:41.880203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:41.880203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:41.880203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:41.880203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:41.880203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:41.880203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:41.880203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:41.880203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:41.880203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:41.880203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 07 20:17:41.880203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 07 20:17:41.880203 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:41.880870 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:41.881548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:41.881548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.881548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:41.881548 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104575) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 07 20:17:41.881548 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.882053 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104575) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 07 20:17:41.882360 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 07 20:17:41.882360 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:41.882360 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:41.882360 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:41.882360 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:41.882360 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:41.882360 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.882360 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:41.883888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.883888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 07 20:17:41.883888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:41.883888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:41.883888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:41.883888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:41.883888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:41.883888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:41.883888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:41.883888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 07 20:17:41.883888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:41.883888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 07 20:17:41.883888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:41.883888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 07 20:17:41.883888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 07 20:17:41.883888 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:41.884558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 07 20:17:41.884558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:41.884558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 07 20:17:41.884558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 07 20:17:41.884558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:41.884558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 07 20:17:41.884558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.884558 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 07 20:17:41.884558 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:41.885969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.885969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:41.885969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:41.885969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:41.885969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:41.885969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:41.885969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:41.885969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:41.885969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:41.885969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:41.885969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:41.885969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:41.885969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:41.885969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 07 20:17:41.885969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 07 20:17:41.885969 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:41.886620 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:41.887356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.887356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics 
Apr 07 20:17:41.887356 np0000164077 neutron-ovn-maintenance-worker[104575]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104575) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 07 20:17:41.887356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.887356 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Traceback (most recent call last):
Apr 07 20:17:41.887356 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:41.887356 np0000164077 neutron-ovn-maintenance-worker[104575]:     txn.results.put(txn.do_commit())
Apr 07 20:17:41.887356 np0000164077 neutron-ovn-maintenance-worker[104575]:                     ^^^^^^^^^^^^^^^
Apr 07 20:17:41.887356 np0000164077 neutron-ovn-maintenance-worker[104575]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:41.887356 np0000164077 neutron-ovn-maintenance-worker[104575]:     raise RuntimeError(msg)
Apr 07 20:17:41.887356 np0000164077 neutron-ovn-maintenance-worker[104575]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.887356 np0000164077 neutron-ovn-maintenance-worker[104575]: 
Apr 07 20:17:41.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics [None req-29b94ddd-4f86-4b27-8656-5f8c6c73f599 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics Traceback (most recent call last):
Apr 07 20:17:41.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 07 20:17:41.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     work()
Apr 07 20:17:41.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 07 20:17:41.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 07 20:17:41.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:41.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 07 20:17:41.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 07 20:17:41.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 07 20:17:41.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 07 20:17:41.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 07 20:17:41.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 07 20:17:41.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 07 20:17:41.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 07 20:17:41.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:41.887915 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     next(self.gen)
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     with self.create_transaction(
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     self.result = self.commit()
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise result.ex
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 07 20:17:41.888695 np0000164077 neutron-ovn-maintenance-worker[104575]: ERROR futurist.periodics